-- Logs begin at Mon 2022-05-23 16:31:21 UTC, end at Mon 2022-05-23 17:40:23 UTC. -- May 23 17:08:47.044414 dv-cinder-842998-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 23 17:08:47.053526 dv-cinder-842998-1-iscsi devstack@n-api.service[103473]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 23 17:08:47.055538 dv-cinder-842998-1-iscsi devstack@n-api.service[103473]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 23 17:08:47 2022] *** May 23 17:08:47.055538 dv-cinder-842998-1-iscsi devstack@n-api.service[103473]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 23 17:08:47.055538 dv-cinder-842998-1-iscsi devstack@n-api.service[103473]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 23 17:08:47.055538 dv-cinder-842998-1-iscsi devstack@n-api.service[103473]: nodename: dv-cinder-842998-1-iscsi May 23 17:08:47.055538 dv-cinder-842998-1-iscsi devstack@n-api.service[103473]: machine: x86_64 May 23 17:08:47.055538 dv-cinder-842998-1-iscsi devstack@n-api.service[103473]: clock source: unix May 23 17:08:47.055538 dv-cinder-842998-1-iscsi devstack@n-api.service[103473]: pcre jit disabled May 23 17:08:47.055538 dv-cinder-842998-1-iscsi devstack@n-api.service[103473]: detected number of CPU cores: 4 May 23 17:08:47.055538 dv-cinder-842998-1-iscsi devstack@n-api.service[103473]: current working directory: / May 23 17:08:47.055538 dv-cinder-842998-1-iscsi devstack@n-api.service[103473]: detected binary path: /usr/bin/uwsgi-core May 23 17:08:47.055538 dv-cinder-842998-1-iscsi devstack@n-api.service[103473]: your processes number limit is 47680 May 23 17:08:47.055538 dv-cinder-842998-1-iscsi devstack@n-api.service[103473]: your memory page size is 4096 bytes May 23 17:08:47.055538 dv-cinder-842998-1-iscsi devstack@n-api.service[103473]: detected max file descriptor number: 2048 May 23 17:08:47.055538 dv-cinder-842998-1-iscsi devstack@n-api.service[103473]: lock engine: pthread robust mutexes May 23 17:08:47.056374 dv-cinder-842998-1-iscsi devstack@n-api.service[103473]: thunder lock: enabled May 23 17:08:47.056374 dv-cinder-842998-1-iscsi devstack@n-api.service[103473]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 23 17:08:47.056374 dv-cinder-842998-1-iscsi devstack@n-api.service[103473]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 23 17:08:47.100238 dv-cinder-842998-1-iscsi devstack@n-api.service[103473]: Python main interpreter initialized at 0x557fb4f739c0 May 23 17:08:47.100238 dv-cinder-842998-1-iscsi devstack@n-api.service[103473]: python threads support enabled May 23 17:08:47.100238 dv-cinder-842998-1-iscsi devstack@n-api.service[103473]: your server socket listen backlog is limited to 100 connections May 23 17:08:47.100238 dv-cinder-842998-1-iscsi devstack@n-api.service[103473]: your mercy for graceful operations on workers is 90 seconds May 23 17:08:47.100712 dv-cinder-842998-1-iscsi devstack@n-api.service[103473]: mapped 403077 bytes (393 KB) for 2 cores May 23 17:08:47.100712 dv-cinder-842998-1-iscsi devstack@n-api.service[103473]: *** Operational MODE: preforking *** May 23 17:08:47.100927 dv-cinder-842998-1-iscsi devstack@n-api.service[103473]: *** uWSGI is running in multiple interpreter mode *** May 23 17:08:47.100927 dv-cinder-842998-1-iscsi devstack@n-api.service[103473]: spawned uWSGI master process (pid: 103473) May 23 17:08:47.101126 dv-cinder-842998-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 23 17:08:47.105850 dv-cinder-842998-1-iscsi devstack@n-api.service[103473]: spawned uWSGI worker 1 (pid: 103474, cores: 1) May 23 17:08:47.105850 dv-cinder-842998-1-iscsi devstack@n-api.service[103473]: spawned uWSGI worker 2 (pid: 103475, cores: 1) May 23 17:08:47.105850 dv-cinder-842998-1-iscsi devstack@n-api.service[103473]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 23 17:08:48.248108 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 23 17:08:48.252224 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 23 17:08:48.961989 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 17:08:48.961989 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: from cryptography.utils import int_from_bytes May 23 17:08:48.962279 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 17:08:48.962279 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: from cryptography.utils import int_from_bytes May 23 17:08:48.963226 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 17:08:48.963226 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: from cryptography.utils import int_from_bytes May 23 17:08:48.963226 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 17:08:48.963226 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: from cryptography.utils import int_from_bytes May 23 17:08:51.518863 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 17:08:51.519561 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 17:08:51.519919 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 17:08:51.520022 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 17:08:51.520098 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 17:08:51.520179 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 17:08:51.520272 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 17:08:51.520349 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 17:08:51.520430 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 17:08:51.520500 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 17:08:51.520572 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.520689 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.520924 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.521027 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.521233 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.521376 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.521544 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.521716 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.521828 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.521914 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.522160 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.522290 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.522471 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.522612 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.522756 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.522852 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.523106 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.523246 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.523346 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.523438 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.523635 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.523741 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.523983 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842998-1-iscsi {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.524116 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842998-1-iscsi {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.524287 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.524396 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.524625 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.524737 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.524907 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.525055 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.525234 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.525356 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.525529 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.525629 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.525854 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.525943 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.526151 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.526249 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.526638 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.526752 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.527934 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.528078 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.528078 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.528272 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.528410 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.528502 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.528581 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.528719 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.528809 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.528896 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.528982 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.529060 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.529194 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.529291 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.529379 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.529464 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.529543 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.529676 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.529831 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.529940 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.530221 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842998-1-iscsi {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.530336 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842998-1-iscsi {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.530535 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.530661 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.530831 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.530954 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.531136 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.531242 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.531539 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.531649 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.531844 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.531939 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.532147 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.532233 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.532466 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.532561 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.532813 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.532945 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.533114 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.533204 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.533434 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.533537 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.533748 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.533848 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.534067 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.534166 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.534380 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.534476 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.534678 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.534765 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.534978 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.535069 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.535299 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.535397 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.535605 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.535774 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.535943 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.536073 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.536206 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.536346 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.536531 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.536701 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.536833 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.536973 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.537105 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.537258 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.537391 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.537547 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.537695 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.537832 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.537974 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.538117 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.538253 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.538407 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.538552 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.538691 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.538832 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.538985 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.539118 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.539250 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.539382 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.539525 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.539657 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.539790 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.539921 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.540052 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.540194 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.540335 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.540466 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.540669 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.540813 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.540955 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.541087 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.541306 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.541450 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.541588 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.541718 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.541856 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.541996 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.542138 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.542269 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.542401 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.542541 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.542688 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.542900 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.543090 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.543235 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.543381 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.543527 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.543667 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.543811 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.543945 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.544090 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.544225 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.544391 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.544479 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.544626 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.544722 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.544970 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.545124 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.545270 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.545389 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.545542 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.545693 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.545828 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.545926 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.546152 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.546300 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.546473 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.546633 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.546720 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.546800 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.547000 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.547147 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.547278 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.547374 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.547594 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.547725 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.547907 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.548059 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.548188 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.548293 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.548503 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.548673 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.548780 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.548863 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.549107 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.549240 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.549412 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.549556 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.549658 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.549741 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.550001 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.550144 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.550273 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.550369 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.550590 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.550720 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.550869 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.550964 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.551174 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.551307 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.551456 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.551550 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.551769 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.551912 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.552063 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.552158 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.552375 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.552466 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.552694 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.552786 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.552994 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.553100 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.553294 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.553393 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.553594 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.553695 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.553911 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.554001 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.554213 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.554314 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.554512 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.554611 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.554824 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.554917 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.555126 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.555227 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.555425 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.555518 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.555732 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.555822 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.556029 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.556120 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.556327 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.556415 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.556662 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.556768 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.556963 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.557053 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.557252 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.557346 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.557561 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.557658 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.557862 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.557953 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.558162 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.558256 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.558457 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.558619 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.558814 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.558900 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.559112 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.559197 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.559413 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.559508 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.559709 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.559795 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.560003 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.560095 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.560298 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.560391 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.560642 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.560744 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.560944 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.561029 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.561244 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.561331 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.561545 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.561629 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.561842 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.561928 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.562154 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.562246 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:08:51.562482 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.562574 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.562806 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.562892 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.563140 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.563225 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.563447 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.563539 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.563774 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.563873 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.564100 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.564196 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.564409 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.564493 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.564740 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.564842 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.565054 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.565140 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.565374 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.565459 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.565680 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.565774 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.565985 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.566068 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.566288 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.566372 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.566601 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.566693 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.566913 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.567093 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.567235 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.567320 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.567544 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.567637 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.567853 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.567945 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.568164 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.568249 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.568470 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.568556 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.568808 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.568898 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.569134 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.569218 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.569453 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.569540 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.569762 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.569847 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.570101 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.570188 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.570437 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.570524 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.570748 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.570845 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.571069 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.571161 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.571384 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.571471 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.571693 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.571777 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.571999 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.572100 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.572307 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.572394 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.572643 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.572763 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.572970 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.573082 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.573277 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.573373 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.573588 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.573682 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.573895 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.574002 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.574226 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.574333 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.574533 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.574635 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.574840 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.574944 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.575143 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.575241 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.575473 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.575579 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.575818 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.575929 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.576089 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.576175 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.576396 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.576490 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.576732 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.576823 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.577042 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.577127 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.577348 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.577432 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.577655 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.577743 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.577956 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.578039 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.578253 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.578346 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.578551 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.578638 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.578852 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.578935 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.579150 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.579243 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.579463 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.579548 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.579784 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.579870 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.580084 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.580222 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.580407 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.580494 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.580732 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.580822 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.581039 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.581186 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.581341 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.581427 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.581642 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.581726 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.581940 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.582033 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.582244 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.582342 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.582545 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.582629 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.582843 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.582944 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.583158 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.583249 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.583460 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.583545 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.583760 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.583847 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.584074 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.584158 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.584373 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.584459 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.584694 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.584783 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.585006 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.585090 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.585309 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.585404 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.585613 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.585700 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.585918 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.586033 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.586223 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.586323 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.586537 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.586632 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.586842 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.586934 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.587147 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.587243 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.587471 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.587564 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.587795 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.587879 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.588095 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.588188 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.588411 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.588495 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.588754 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.588844 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.589065 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.589169 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.589362 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.589447 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.589669 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.589864 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.590020 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.590190 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.590320 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.590406 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.590619 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.590713 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.590919 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.591007 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.591220 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.591321 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.591515 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.591610 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.591813 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.591900 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.592110 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.592202 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.592408 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.592496 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.592745 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.592834 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.593049 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.593148 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.593346 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.593440 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.593642 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.593773 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.593935 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.594031 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.594269 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.594364 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.594568 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.594652 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.594901 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.594985 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.595225 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.595318 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.595537 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.595628 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.595852 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.596008 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.596142 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.596287 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.596450 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.596539 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.596778 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.596867 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.597084 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.597187 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.597386 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.597471 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.597692 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.597778 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.598003 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.598089 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.598308 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.598391 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.598620 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.598704 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.598922 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.599016 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.599240 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.599325 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.599543 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.599635 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.599855 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.599941 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.600154 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.600246 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.600463 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.600548 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.600820 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.600915 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.601145 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.601237 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.601455 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.601543 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.601770 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.601856 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.602072 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.602156 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.602378 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.602472 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.602677 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.602761 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.602981 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.603066 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.603284 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.603377 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.603588 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.603681 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.603897 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.603984 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.604200 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.604292 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.604511 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.604594 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.604838 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.604925 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.605156 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.605254 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.605483 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.605568 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.605794 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.605878 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.606094 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.606231 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.606400 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.606526 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.606716 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.606801 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.607041 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.607135 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.607346 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.607438 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.607650 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.607768 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.607967 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.608054 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.608273 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.608356 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.608576 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.608734 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.608905 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.608992 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.609204 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.609291 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.609502 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.609586 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.609805 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.609892 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.610113 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.610197 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.610416 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.610509 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.610719 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.610820 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.611017 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.611108 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.611326 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.611432 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.611625 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.611719 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.611924 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.612008 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.612221 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.612315 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.612522 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.612651 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.612861 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.612960 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.613167 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.613262 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.613479 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.613572 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.613794 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.613878 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.614094 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.614196 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.614392 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.614478 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.614706 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.614797 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.615009 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.615094 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.615306 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.615389 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.615604 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.615690 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.615902 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.615988 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.616237 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.616321 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.616540 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.616644 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.616864 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.616963 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.617172 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.617257 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.617485 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.617578 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.617790 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.617883 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.618098 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.618200 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.618398 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.618566 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.618700 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.618784 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.619011 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.619097 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.619317 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.619410 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.619619 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.619705 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.619920 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.620008 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.620222 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.620315 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.620524 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.620636 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.620850 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.620947 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.621217 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.621306 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.621525 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.621610 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.621828 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.621914 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.622180 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.622294 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.622432 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.622524 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.622736 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.622830 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.623042 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.623128 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.623607 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.623702 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.623931 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.624026 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.624240 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.624339 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.624553 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.624682 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.624894 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.624993 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.625203 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.625302 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.625527 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.625620 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.625846 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.625943 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.626178 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.626275 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.626478 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.626574 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.626783 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.626869 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.627110 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.627311 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.627543 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.627669 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.627764 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.627966 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.628106 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.628263 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.628415 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.628561 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.628745 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.628888 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.629052 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.629261 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.629454 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.629625 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.629797 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.629956 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.630090 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.630323 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.630415 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.630632 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.630719 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.630985 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.631082 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.631232 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.631321 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.631536 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.631622 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.631837 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.631939 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.632135 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.632224 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.632432 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.632519 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.632749 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.632852 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.633078 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.633172 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.633378 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.633472 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.633676 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.633771 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.634013 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.634104 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.634318 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.634419 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.634632 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.634729 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.634932 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.635031 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.635251 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.635340 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.635551 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.635640 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.635851 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.635937 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.636152 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.636259 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.636457 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.636662 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.636800 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.636928 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.637098 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.637197 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.637403 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.637491 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.637708 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.637795 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.638006 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.638098 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.638307 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.638394 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.638604 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.638689 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.638904 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.638997 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.639553 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.639640 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.639853 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.639952 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.640155 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.640252 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.640452 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.640536 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.640771 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.640858 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.641076 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.641176 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.641377 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.641465 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.641676 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.641763 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.641978 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.642072 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.642271 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.642357 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.642569 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.642661 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.642868 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.642956 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.643164 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.643248 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.643458 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.643541 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.643760 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.643848 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.644057 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.644140 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.644352 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.644444 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.644673 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.644764 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.644976 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.645061 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.645272 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.645368 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.645570 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.645657 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.645873 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.645959 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.646170 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.646306 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.646466 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.646584 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.646766 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.646851 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.647066 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.647165 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.647364 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.647450 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.647664 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.647750 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.647971 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.648066 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.648272 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.648358 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.648569 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.648668 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.648904 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.649002 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.649203 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.649296 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.649498 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.649590 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.649796 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.649887 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.650093 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.650180 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.650390 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.650475 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.650690 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.650777 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.651007 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.651092 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.651306 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.651390 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.651600 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.651686 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.651896 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.651982 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.652192 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.652297 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.652539 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.652646 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.652863 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.652949 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.653162 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.653282 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.653499 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.653593 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.653801 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.653896 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.654178 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.654271 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.654486 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.654571 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.654792 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.654885 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.655101 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.655199 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.655401 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.655487 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.655712 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.655797 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.656015 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.656110 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.656316 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.656402 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.656637 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.656768 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.656933 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.657021 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.657242 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.657336 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.657543 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.657637 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.657842 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.657930 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.658154 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.658237 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.658458 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.658554 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.658762 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.658849 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.659063 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.659154 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.659365 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.659452 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.659670 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.659757 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.659971 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.660056 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.660274 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.660358 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.660574 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.660720 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.660899 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.660994 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.661203 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.661306 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.661503 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.661589 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.661807 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.661893 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.662112 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.662207 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.662413 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.662506 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.662715 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.662809 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.663013 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.663107 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.663312 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.663405 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.663617 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.663703 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.663915 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.664010 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.664213 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.664309 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.664513 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.664683 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.664836 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.664924 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.665144 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.665229 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.665444 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.665530 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.665813 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.665899 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.666116 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.666201 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.666418 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.666503 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.666746 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.666874 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.667055 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.667136 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.667361 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.667465 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.667671 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.667771 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.668043 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.668140 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.668351 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.668445 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.668691 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.668781 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.669002 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.669090 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.669306 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.669400 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.669670 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.669763 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.669971 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.670058 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.670272 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.670366 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.670576 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.670662 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.670883 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.670967 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.671181 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.671340 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.671481 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.671568 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.671782 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.671884 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.672082 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.672177 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.672382 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.672468 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.672709 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.672798 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.673026 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.673123 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.673325 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.673410 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.673642 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.673727 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.674049 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.674145 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.674353 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.674439 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.674654 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.674792 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.674982 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.675069 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.675297 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.675384 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.675616 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.675711 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.675919 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.676004 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.676227 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.676321 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.676531 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.676672 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.676863 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.676968 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.677172 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.677302 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.677477 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.677563 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.677792 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.677885 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.678093 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.678179 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.678402 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.678488 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.678715 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.678810 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.679019 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.679104 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.679331 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.679415 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.679644 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.679737 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.679953 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.680038 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.680271 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.680363 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.680671 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.680761 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.680998 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.681083 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.681300 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.681395 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.681598 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.681695 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.681902 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.681988 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.682202 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.682286 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.682503 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.682589 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.682815 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.682901 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.683106 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.683204 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.683406 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.683509 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.683734 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.683822 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.684038 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.684134 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.684338 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.684423 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.684657 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.684746 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.684961 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.685072 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.685261 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.685354 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.685560 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.685646 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.685871 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.685966 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.686172 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.686257 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.686487 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.686573 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.686789 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.686891 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.687105 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.687200 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.687411 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.687499 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.687720 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.687807 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.688008 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.688103 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.688306 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.688391 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.688621 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.688723 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.688926 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.689020 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.689225 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.689319 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.689559 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.689647 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.689862 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.689958 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.690169 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.690270 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.690492 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.690578 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.690812 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.690895 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.691121 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.691219 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.691434 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.691530 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.691755 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.691842 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.692055 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.692154 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.692353 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.692438 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.692679 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.692770 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.692983 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.693081 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.693283 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.693368 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.693579 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.693672 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.693876 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.693970 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.694170 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.694264 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.694463 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.694548 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.694758 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.694859 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.695054 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.695148 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.695357 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.695445 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.695654 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.695749 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.695959 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.696052 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.696254 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.696347 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.696549 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.696677 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.696875 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.696966 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.697200 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.697294 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.697497 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.697582 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.697790 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.697875 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.698125 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.698219 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.698424 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.698512 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.698741 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.698842 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.699043 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.699158 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.699413 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.699507 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.699736 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.699822 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.700041 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.700136 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.700358 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.700453 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.700687 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.700777 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.700997 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.701084 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.701303 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.701387 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.701612 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.701696 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.701911 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.701997 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.702216 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.702302 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.702521 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.702605 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.702821 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.702919 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.703128 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.703333 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.703419 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.703659 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.703755 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.703969 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.704230 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.704316 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.704558 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.704679 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.704886 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.704971 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.705191 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.705298 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.705492 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.705588 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.705795 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.705881 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.706098 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.706192 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.706400 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.706494 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.706705 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.706791 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.707009 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.707103 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.707314 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.707409 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.707632 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.707721 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.707948 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.708033 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.708259 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.708347 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.708566 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.708702 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.708898 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.708984 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.709204 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.709291 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.709515 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.709602 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.709824 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.709985 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.710132 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.710219 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.710443 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.710529 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.710753 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.710847 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.711060 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.711147 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.711362 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.711454 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.711671 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.711758 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.711978 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.712065 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.712281 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.712366 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.712586 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.712691 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.712919 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.713005 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.713225 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.713309 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.713526 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.713614 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.713833 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.713920 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.714141 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.714241 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.714460 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.714546 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.714801 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.714891 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.715117 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.715221 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.715431 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.715633 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.715742 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.715946 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.716053 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.716277 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.716570 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.716722 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.716904 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.717008 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.717235 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.717357 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.717549 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.717636 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.717868 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.717962 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.718169 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.718314 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.718473 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.718568 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.718781 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.718867 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.719087 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.719174 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.719387 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.719471 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.719692 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.719776 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.719998 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.720085 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.720297 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.720382 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.720659 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.720767 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.720939 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.721024 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.721237 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.721463 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.721549 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.721803 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.721890 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.722115 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.722358 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.722488 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.722697 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.722816 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.723008 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.723117 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.723329 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.723427 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.723643 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.723751 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.723945 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.724040 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.724243 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.724329 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.724552 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.724669 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.724878 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.724965 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.725184 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.725286 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.725481 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.725571 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.725786 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.725872 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.726084 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.726176 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.726382 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.726468 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.726685 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.726772 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.726983 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.727111 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.727282 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.727369 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.727588 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.727732 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.727888 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.728027 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.728185 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.728321 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.728491 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.728657 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.728814 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.728953 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.729113 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.729241 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.729412 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.729541 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.729709 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.729845 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.730008 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.730138 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.730303 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.730488 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.730652 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.730789 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.730952 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.731086 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.731249 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.731377 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.731549 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.731690 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.731850 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.731989 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.732157 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.732300 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.732442 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.732583 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.732773 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.732872 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.733096 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.733181 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.733407 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.733495 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.733710 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.733813 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.734012 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.734097 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.734320 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.734407 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.734623 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.734709 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.734942 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.735043 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.735254 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.735384 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.735559 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.735781 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.735902 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.736111 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.736199 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.736427 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.736750 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.736858 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.737079 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.737218 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.737382 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.737467 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.737693 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.737788 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.737996 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.738100 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.738310 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.738399 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.738613 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.738697 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.738913 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.739011 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.739214 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.739298 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.739517 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.739604 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.739821 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.739908 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.740123 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.740209 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.740426 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.740513 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.740749 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.740838 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.741053 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.741138 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.741353 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.741458 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.741653 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.741739 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.741961 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.742046 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.742265 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.742359 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.742568 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.742662 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.742870 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.742956 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.743177 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.743272 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.743494 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.743587 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.743804 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.743891 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.744113 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.744200 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.744419 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.744505 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.744746 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.744849 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.745052 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.745139 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.745356 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.745485 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.745658 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.745751 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.745982 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.746073 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.746284 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.746377 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.746620 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.746714 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.746929 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.747022 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.747228 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.747314 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.747593 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.747688 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.747902 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.748029 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.748216 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.748302 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.748540 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.748664 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.748864 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.748951 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.749179 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.749264 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.749485 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.749579 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.749812 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.749906 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.750138 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.750223 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.750444 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.750532 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.750765 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.750850 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.751065 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.751151 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.751368 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.751468 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.751666 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.751761 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.751970 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.752057 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.752284 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.752370 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.752585 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.752704 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.752907 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.753006 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.753205 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.753292 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.753515 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.753601 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.753814 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.753909 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.754111 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.754200 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.754406 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.754491 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.754702 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.754797 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.755002 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.755087 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.755298 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.755391 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.755596 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.755692 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.755894 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.755989 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.756191 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.756277 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.756487 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.756574 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.756810 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.756898 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.757112 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.757197 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.757409 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.757506 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.757716 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.757809 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.758015 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.758143 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.758311 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.758398 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.758607 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.758693 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.758901 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.758985 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.759204 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.759292 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.759501 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.759595 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.759827 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.759923 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.760144 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.760230 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.760461 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.760545 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.760793 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.760892 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.761105 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.761191 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.761421 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.761505 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.761772 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.761869 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.762096 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.762181 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.762410 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.762497 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.762712 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.762808 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.763016 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.763100 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.763320 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.763415 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.763626 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.763756 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.763928 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.764372 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.764613 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.764701 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.764926 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.765014 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.765237 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.765325 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.765539 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.765669 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.765858 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.765945 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.766166 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.766251 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.766468 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.766562 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.766779 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.766864 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.767084 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.767170 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.767397 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.767596 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.767689 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.767767 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.767998 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.768092 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.768306 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.768406 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.768647 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.768752 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.768981 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.769075 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.769242 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.769329 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.769545 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.769631 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.769851 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.769937 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.770163 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.770250 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.770465 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.770550 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.770791 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.770883 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.771103 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.771198 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.771406 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.771501 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.771726 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.771821 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.772049 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.772137 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.772367 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.772451 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.772699 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.772806 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.773008 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.773103 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.773309 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.773403 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.773551 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 17:08:51.773652 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.773927 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.774234 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:08:51.774473 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 17:08:51.830609 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO dbcounter [None req-d55e0149-0f93-4188-a986-a52b55effa3e None None] Registered counter for database nova_api May 23 17:08:51.833084 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO dbcounter [None req-c1d6bd6f-16f9-4fdb-b318-a97411bf1010 None None] Registered counter for database nova_api May 23 17:08:51.850845 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG oslo_db.sqlalchemy.engines [None req-d55e0149-0f93-4188-a986-a52b55effa3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 17:08:51.852761 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_db.sqlalchemy.engines [None req-c1d6bd6f-16f9-4fdb-b318-a97411bf1010 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 17:08:51.857821 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG dbcounter [-] [103474] Writer thread running {{(pid=103474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 17:08:51.859577 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG dbcounter [-] [103475] Writer thread running {{(pid=103475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 17:08:51.913445 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.context [None req-d55e0149-0f93-4188-a986-a52b55effa3e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),00a96999-6d6a-4eda-a805-882c38016a13(cell1) {{(pid=103474) load_cells /opt/stack/nova/nova/context.py:464}} May 23 17:08:51.916108 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.context [None req-c1d6bd6f-16f9-4fdb-b318-a97411bf1010 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),00a96999-6d6a-4eda-a805-882c38016a13(cell1) {{(pid=103475) load_cells /opt/stack/nova/nova/context.py:464}} May 23 17:08:51.917555 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG oslo_concurrency.lockutils [None req-d55e0149-0f93-4188-a986-a52b55effa3e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:08:51.919213 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG oslo_concurrency.lockutils [None req-d55e0149-0f93-4188-a986-a52b55effa3e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:08:51.920032 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG oslo_concurrency.lockutils [None req-d55e0149-0f93-4188-a986-a52b55effa3e None None] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:08:51.920362 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-c1d6bd6f-16f9-4fdb-b318-a97411bf1010 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:08:51.921991 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-c1d6bd6f-16f9-4fdb-b318-a97411bf1010 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:08:51.922128 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG oslo_concurrency.lockutils [None req-d55e0149-0f93-4188-a986-a52b55effa3e None None] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:08:51.922789 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-c1d6bd6f-16f9-4fdb-b318-a97411bf1010 None None] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:08:51.924008 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO dbcounter [None req-d55e0149-0f93-4188-a986-a52b55effa3e None None] Registered counter for database nova_cell0 May 23 17:08:51.924790 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-c1d6bd6f-16f9-4fdb-b318-a97411bf1010 None None] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:08:51.926842 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO dbcounter [None req-c1d6bd6f-16f9-4fdb-b318-a97411bf1010 None None] Registered counter for database nova_cell0 May 23 17:08:51.927990 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO dbcounter [None req-d55e0149-0f93-4188-a986-a52b55effa3e None None] Registered counter for database nova_cell1 May 23 17:08:51.930893 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO dbcounter [None req-c1d6bd6f-16f9-4fdb-b318-a97411bf1010 None None] Registered counter for database nova_cell1 May 23 17:08:51.935657 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG oslo_db.sqlalchemy.engines [None req-d55e0149-0f93-4188-a986-a52b55effa3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 17:08:51.937452 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG oslo_db.sqlalchemy.engines [None req-d55e0149-0f93-4188-a986-a52b55effa3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 17:08:51.938941 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_db.sqlalchemy.engines [None req-c1d6bd6f-16f9-4fdb-b318-a97411bf1010 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 17:08:51.942269 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_db.sqlalchemy.engines [None req-c1d6bd6f-16f9-4fdb-b318-a97411bf1010 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 17:08:51.943215 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG dbcounter [-] [103474] Writer thread running {{(pid=103474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 17:08:51.945234 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG dbcounter [-] [103475] Writer thread running {{(pid=103475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 17:08:52.079092 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG dbcounter [-] [103474] Writer thread running {{(pid=103474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 17:08:52.088289 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO dbcounter [None req-d55e0149-0f93-4188-a986-a52b55effa3e None None] Registered counter for database nova_cell0 May 23 17:08:52.090969 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG dbcounter [-] [103475] Writer thread running {{(pid=103475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 17:08:52.097488 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG oslo_db.sqlalchemy.engines [None req-d55e0149-0f93-4188-a986-a52b55effa3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 17:08:52.100782 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO dbcounter [None req-c1d6bd6f-16f9-4fdb-b318-a97411bf1010 None None] Registered counter for database nova_cell0 May 23 17:08:52.102315 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG dbcounter [-] [103474] Writer thread running {{(pid=103474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 17:08:52.109878 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_db.sqlalchemy.engines [None req-c1d6bd6f-16f9-4fdb-b318-a97411bf1010 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 17:08:52.114865 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG dbcounter [-] [103475] Writer thread running {{(pid=103475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 17:08:52.438918 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: WARNING keystonemiddleware.auth_token [None req-c1d6bd6f-16f9-4fdb-b318-a97411bf1010 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 17:08:52.444194 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: WARNING keystonemiddleware.auth_token [None req-d55e0149-0f93-4188-a986-a52b55effa3e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 17:08:52.446175 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: WARNING keystonemiddleware.auth_token [None req-c1d6bd6f-16f9-4fdb-b318-a97411bf1010 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 17:08:52.451565 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: WARNING keystonemiddleware.auth_token [None req-d55e0149-0f93-4188-a986-a52b55effa3e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 17:08:52.791494 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: WARNING keystonemiddleware.auth_token [None req-c1d6bd6f-16f9-4fdb-b318-a97411bf1010 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 17:08:52.797502 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: WARNING keystonemiddleware.auth_token [None req-c1d6bd6f-16f9-4fdb-b318-a97411bf1010 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 17:08:52.802765 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557fb4f739c0 pid: 103475 (default app) May 23 17:08:52.804861 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-c1d6bd6f-16f9-4fdb-b318-a97411bf1010 None None] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:08:52.805407 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: WARNING keystonemiddleware.auth_token [None req-d55e0149-0f93-4188-a986-a52b55effa3e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 17:08:52.806038 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-c1d6bd6f-16f9-4fdb-b318-a97411bf1010 None None] 10.222.0.46 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001773 May 23 17:08:52.806448 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 788 bytes} [Mon May 23 17:08:52 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:08:52.811439 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: WARNING keystonemiddleware.auth_token [None req-d55e0149-0f93-4188-a986-a52b55effa3e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 17:08:52.816789 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557fb4f739c0 pid: 103474 (default app) May 23 17:10:10.605004 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-c1d6bd6f-16f9-4fdb-b318-a97411bf1010 None None] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:10:10.606019 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-c1d6bd6f-16f9-4fdb-b318-a97411bf1010 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001611 May 23 17:10:10.606401 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 2/2] 10.222.0.46 () {54 vars in 930 bytes} [Mon May 23 17:10:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:10:10.618302 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG dbcounter [-] [103474] Writing DB stats nova_api:SELECT=3 {{(pid=103474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:10.619668 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG dbcounter [-] [103474] Writing DB stats nova_cell0:SELECT=3 {{(pid=103474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:10.620715 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG dbcounter [-] [103474] Writing DB stats nova_cell1:SELECT=3 {{(pid=103474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:10.621522 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG dbcounter [-] [103474] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:11.047771 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi [None req-d5d7a952-213a-4b06-8beb-126753336995 admin admin] Calling method '>' {{(pid=103474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:10:11.078946 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO nova.api.openstack.requestlog [None req-d5d7a952-213a-4b06-8beb-126753336995 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.465646 May 23 17:10:11.086026 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: [pid: 103474|app: 0|req: 1/3] 10.222.0.46 () {60 vars in 1291 bytes} [Mon May 23 17:10:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:10:13.349309 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-c1d6bd6f-16f9-4fdb-b318-a97411bf1010 None None] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:10:13.351411 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-c1d6bd6f-16f9-4fdb-b318-a97411bf1010 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002576 May 23 17:10:13.352036 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 3/4] 10.222.0.46 () {54 vars in 930 bytes} [Mon May 23 17:10:13 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:10:13.411439 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi [None req-5619ab22-4bea-4eed-bf41-076e78a38e1d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "cirros256", "ram": 256, "id": "c1"}} {{(pid=103474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:10:13.429486 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 17:10:13.429486 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: warnings.warn(msg) May 23 17:10:13.458173 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO nova.api.openstack.requestlog [None req-5619ab22-4bea-4eed-bf41-076e78a38e1d admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.099887 May 23 17:10:13.460735 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: [pid: 103474|app: 0|req: 2/5] 10.222.0.46 () {64 vars in 1282 bytes} [Mon May 23 17:10:13 2022] POST /compute/v2.1/flavors => generated 407 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 17:10:13.472972 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG dbcounter [-] [103475] Writing DB stats nova_api:SELECT=3 {{(pid=103475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:13.474164 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG dbcounter [-] [103475] Writing DB stats nova_cell0:SELECT=3 {{(pid=103475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:13.475634 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG dbcounter [-] [103475] Writing DB stats nova_cell1:SELECT=3 {{(pid=103475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:13.476398 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG dbcounter [-] [103475] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:10:13.690645 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-1fcd2ba9-3fa4-4210-b5c5-121eb5ddce95 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:10:13.693145 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 17:10:13.693145 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: warnings.warn(msg) May 23 17:10:13.754815 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-1fcd2ba9-3fa4-4210-b5c5-121eb5ddce95 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.287590 May 23 17:10:13.755598 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 4/6] 10.222.0.46 () {64 vars in 1335 bytes} [Mon May 23 17:10:13 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:10:15.973317 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi [None req-5619ab22-4bea-4eed-bf41-076e78a38e1d admin admin] Calling method '>' {{(pid=103474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:10:15.974341 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO nova.api.openstack.requestlog [None req-5619ab22-4bea-4eed-bf41-076e78a38e1d admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 May 23 17:10:15.974938 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: [pid: 103474|app: 0|req: 3/7] 10.222.0.46 () {54 vars in 930 bytes} [Mon May 23 17:10:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:10:16.107806 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-90d832c0-885d-401b-bc25-868fa55d0d88 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "id": "d1", "name": "ds512M", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:10:16.126238 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 17:10:16.126238 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: warnings.warn(msg) May 23 17:10:16.145478 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-90d832c0-885d-401b-bc25-868fa55d0d88 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.160644 May 23 17:10:16.146094 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 5/8] 10.222.0.46 () {64 vars in 1282 bytes} [Mon May 23 17:10:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 17:10:16.158340 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi [None req-35eb773c-4d85-4861-9823-f8632991a2bb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:10:16.159827 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 17:10:16.159827 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: warnings.warn(msg) May 23 17:10:16.191580 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO nova.api.openstack.requestlog [None req-35eb773c-4d85-4861-9823-f8632991a2bb admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037014 May 23 17:10:16.192168 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: [pid: 103474|app: 0|req: 4/9] 10.222.0.46 () {64 vars in 1335 bytes} [Mon May 23 17:10:16 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:10:18.443681 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-90d832c0-885d-401b-bc25-868fa55d0d88 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:10:18.444777 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-90d832c0-885d-401b-bc25-868fa55d0d88 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 May 23 17:10:18.445177 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 6/10] 10.222.0.46 () {54 vars in 930 bytes} [Mon May 23 17:10:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:10:18.505220 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi [None req-238331c3-e69e-4542-b006-11cac4529183 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds1G", "id": "d2", "disk": 10, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 1024, "swap": 0}} {{(pid=103474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:10:18.526520 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO nova.api.openstack.requestlog [None req-238331c3-e69e-4542-b006-11cac4529183 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075119 May 23 17:10:18.527337 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: [pid: 103474|app: 0|req: 5/11] 10.222.0.46 () {64 vars in 1282 bytes} [Mon May 23 17:10:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 17:10:18.539817 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-fdd90832-2624-439e-8e30-115d28146648 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:10:18.567025 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-fdd90832-2624-439e-8e30-115d28146648 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031074 May 23 17:10:18.568097 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 7/12] 10.222.0.46 () {64 vars in 1335 bytes} [Mon May 23 17:10:18 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:10:20.845461 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi [None req-238331c3-e69e-4542-b006-11cac4529183 admin admin] Calling method '>' {{(pid=103474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:10:20.846388 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO nova.api.openstack.requestlog [None req-238331c3-e69e-4542-b006-11cac4529183 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 May 23 17:10:20.846789 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: [pid: 103474|app: 0|req: 6/13] 10.222.0.46 () {54 vars in 930 bytes} [Mon May 23 17:10:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:10:20.911919 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-ae808649-a9cc-42be-afe9-e0362a4f9309 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "id": "d3", "vcpus": 2, "ram": 2048, "name": "ds2G", "rxtx_factor": 1.0}} {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:10:20.932166 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-ae808649-a9cc-42be-afe9-e0362a4f9309 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078510 May 23 17:10:20.932752 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 8/14] 10.222.0.46 () {64 vars in 1282 bytes} [Mon May 23 17:10:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 17:10:20.945409 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi [None req-e93f3398-e5a0-404e-affa-256fb092d3f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:10:20.970451 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO nova.api.openstack.requestlog [None req-e93f3398-e5a0-404e-affa-256fb092d3f2 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028899 May 23 17:10:20.971042 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: [pid: 103474|app: 0|req: 7/15] 10.222.0.46 () {64 vars in 1335 bytes} [Mon May 23 17:10:20 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:10:23.232444 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-ae808649-a9cc-42be-afe9-e0362a4f9309 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:10:23.234751 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-ae808649-a9cc-42be-afe9-e0362a4f9309 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003244 May 23 17:10:23.236259 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 9/16] 10.222.0.46 () {54 vars in 930 bytes} [Mon May 23 17:10:23 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:10:23.297767 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi [None req-ec3aa227-2002-4d45-b323-984c083ffe09 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds4G", "id": "d4", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "ram": 4096, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:10:23.316574 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO nova.api.openstack.requestlog [None req-ec3aa227-2002-4d45-b323-984c083ffe09 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071845 May 23 17:10:23.317336 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: [pid: 103474|app: 0|req: 8/17] 10.222.0.46 () {64 vars in 1282 bytes} [Mon May 23 17:10:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 17:10:23.329045 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-db7d87c3-e7ed-4d8d-baa6-6c762aa25df8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:10:23.353675 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-db7d87c3-e7ed-4d8d-baa6-6c762aa25df8 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028293 May 23 17:10:23.354408 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 10/18] 10.222.0.46 () {64 vars in 1335 bytes} [Mon May 23 17:10:23 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:10:25.591982 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi [None req-ec3aa227-2002-4d45-b323-984c083ffe09 admin admin] Calling method '>' {{(pid=103474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:10:25.594065 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO nova.api.openstack.requestlog [None req-ec3aa227-2002-4d45-b323-984c083ffe09 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002670 May 23 17:10:25.594778 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: [pid: 103474|app: 0|req: 9/19] 10.222.0.46 () {54 vars in 930 bytes} [Mon May 23 17:10:25 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:10:25.663514 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-65f48d67-9686-48d6-85a4-c8e739b5f2dd admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:10:25.690076 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-65f48d67-9686-48d6-85a4-c8e739b5f2dd admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.086869 May 23 17:10:25.690851 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 11/20] 10.222.0.46 () {60 vars in 1291 bytes} [Mon May 23 17:10:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 17:10:27.936822 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi [None req-ec3aa227-2002-4d45-b323-984c083ffe09 admin admin] Calling method '>' {{(pid=103474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:10:27.937844 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO nova.api.openstack.requestlog [None req-ec3aa227-2002-4d45-b323-984c083ffe09 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 May 23 17:10:27.938397 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: [pid: 103474|app: 0|req: 10/21] 10.222.0.46 () {54 vars in 930 bytes} [Mon May 23 17:10:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:10:27.997533 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-84479973-e812-4fab-835f-fed634cefd0e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "1", "ram": 512, "name": "m1.tiny", "disk": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:10:28.016950 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-84479973-e812-4fab-835f-fed634cefd0e admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.072711 May 23 17:10:28.017521 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 12/22] 10.222.0.46 () {64 vars in 1282 bytes} [Mon May 23 17:10:27 2022] POST /compute/v2.1/flavors => generated 402 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 17:10:28.033386 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi [None req-9797717f-45f9-4865-b62d-46d4f5041ab9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:10:28.060718 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO nova.api.openstack.requestlog [None req-9797717f-45f9-4865-b62d-46d4f5041ab9 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034372 May 23 17:10:28.061703 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: [pid: 103474|app: 0|req: 11/23] 10.222.0.46 () {64 vars in 1332 bytes} [Mon May 23 17:10:28 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:10:30.779330 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-84479973-e812-4fab-835f-fed634cefd0e admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:10:30.780575 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-84479973-e812-4fab-835f-fed634cefd0e admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001953 May 23 17:10:30.781159 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 13/24] 10.222.0.46 () {54 vars in 930 bytes} [Mon May 23 17:10:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:10:30.846616 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi [None req-b7290fe0-52e2-497e-89fd-6ea050b1516c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.small", "swap": 0, "disk": 20, "id": "2", "rxtx_factor": 1.0}} {{(pid=103474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:10:30.865116 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO nova.api.openstack.requestlog [None req-b7290fe0-52e2-497e-89fd-6ea050b1516c admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076791 May 23 17:10:30.865708 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: [pid: 103474|app: 0|req: 12/25] 10.222.0.46 () {64 vars in 1282 bytes} [Mon May 23 17:10:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 17:10:30.877794 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-868ebb7e-8cf5-4584-8b66-2d9784ee24ab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:10:30.903947 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-868ebb7e-8cf5-4584-8b66-2d9784ee24ab admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029686 May 23 17:10:30.904857 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 14/26] 10.222.0.46 () {64 vars in 1332 bytes} [Mon May 23 17:10:30 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:10:33.668377 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi [None req-b7290fe0-52e2-497e-89fd-6ea050b1516c admin admin] Calling method '>' {{(pid=103474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:10:33.669442 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO nova.api.openstack.requestlog [None req-b7290fe0-52e2-497e-89fd-6ea050b1516c admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 May 23 17:10:33.669819 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: [pid: 103474|app: 0|req: 13/27] 10.222.0.46 () {54 vars in 930 bytes} [Mon May 23 17:10:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:10:33.731374 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-819a1507-c713-4b78-ba89-33132541e7c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "disk": 40, "vcpus": 2, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3"}} {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:10:33.750190 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-819a1507-c713-4b78-ba89-33132541e7c1 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.074598 May 23 17:10:33.750848 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 15/28] 10.222.0.46 () {64 vars in 1282 bytes} [Mon May 23 17:10:33 2022] POST /compute/v2.1/flavors => generated 406 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 17:10:33.763641 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi [None req-fbf90987-bd38-4492-ad13-ee640ba0fe80 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:10:33.787401 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO nova.api.openstack.requestlog [None req-fbf90987-bd38-4492-ad13-ee640ba0fe80 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027730 May 23 17:10:33.788812 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: [pid: 103474|app: 0|req: 14/29] 10.222.0.46 () {64 vars in 1332 bytes} [Mon May 23 17:10:33 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:10:36.057293 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-819a1507-c713-4b78-ba89-33132541e7c1 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:10:36.058306 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-819a1507-c713-4b78-ba89-33132541e7c1 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 May 23 17:10:36.058867 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 16/30] 10.222.0.46 () {54 vars in 930 bytes} [Mon May 23 17:10:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:10:36.131616 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi [None req-8fb5f8a7-f8df-458c-9d70-dac643ce27c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "4", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.large", "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80}} {{(pid=103474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:10:36.150411 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO nova.api.openstack.requestlog [None req-8fb5f8a7-f8df-458c-9d70-dac643ce27c1 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.085404 May 23 17:10:36.150992 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: [pid: 103474|app: 0|req: 15/31] 10.222.0.46 () {64 vars in 1282 bytes} [Mon May 23 17:10:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 17:10:36.163078 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-540dc4f8-1472-4020-bd4d-8ed0959bbcb9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:10:36.188957 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-540dc4f8-1472-4020-bd4d-8ed0959bbcb9 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029509 May 23 17:10:36.189714 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 17/32] 10.222.0.46 () {64 vars in 1332 bytes} [Mon May 23 17:10:36 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:10:38.449860 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi [None req-8fb5f8a7-f8df-458c-9d70-dac643ce27c1 admin admin] Calling method '>' {{(pid=103474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:10:38.450959 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO nova.api.openstack.requestlog [None req-8fb5f8a7-f8df-458c-9d70-dac643ce27c1 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002041 May 23 17:10:38.451359 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: [pid: 103474|app: 0|req: 16/33] 10.222.0.46 () {54 vars in 930 bytes} [Mon May 23 17:10:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:10:38.511047 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-066f3a38-7fbe-47dd-9454-7a6c4a8aec07 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 16384, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "vcpus": 8, "name": "m1.xlarge", "disk": 160}} {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:10:38.534636 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-066f3a38-7fbe-47dd-9454-7a6c4a8aec07 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.077033 May 23 17:10:38.535185 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 18/34] 10.222.0.46 () {64 vars in 1282 bytes} [Mon May 23 17:10:38 2022] POST /compute/v2.1/flavors => generated 408 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 17:10:38.547274 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi [None req-78cc5125-2986-4704-a066-543503f76fd0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:10:38.571869 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO nova.api.openstack.requestlog [None req-78cc5125-2986-4704-a066-543503f76fd0 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028405 May 23 17:10:38.572900 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: [pid: 103474|app: 0|req: 17/35] 10.222.0.46 () {64 vars in 1332 bytes} [Mon May 23 17:10:38 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:11:02.465954 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-066f3a38-7fbe-47dd-9454-7a6c4a8aec07 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:11:02.466963 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-066f3a38-7fbe-47dd-9454-7a6c4a8aec07 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 23 17:11:02.467356 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 19/36] 10.222.0.46 () {54 vars in 930 bytes} [Mon May 23 17:11:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:11:02.478148 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG dbcounter [-] [103474] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:11:02.529683 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi [None req-b305931e-97a3-4515-a9aa-6774dbb40067 admin admin] Calling method '>' {{(pid=103474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:11:02.547078 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO nova.api.openstack.requestlog [None req-b305931e-97a3-4515-a9aa-6774dbb40067 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.073543 May 23 17:11:02.547621 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: [pid: 103474|app: 0|req: 18/37] 10.222.0.46 () {60 vars in 1291 bytes} [Mon May 23 17:11:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 17:11:03.553977 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-066f3a38-7fbe-47dd-9454-7a6c4a8aec07 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:11:03.554981 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-066f3a38-7fbe-47dd-9454-7a6c4a8aec07 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 May 23 17:11:03.555386 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 20/38] 10.222.0.46 () {56 vars in 1074 bytes} [Mon May 23 17:11:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:11:03.765369 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi [None req-7a15069e-21b5-46ff-a160-e179ddc46b3b admin admin] Calling method '>' {{(pid=103474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:11:03.771513 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO nova.api.openstack.wsgi [None req-7a15069e-21b5-46ff-a160-e179ddc46b3b admin admin] HTTP exception thrown: Flavor 42 could not be found. May 23 17:11:03.774776 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi [None req-7a15069e-21b5-46ff-a160-e179ddc46b3b admin admin] Request method failure captured: May 23 17:11:03.774776 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 23 17:11:03.774776 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: Accept: application/json May 23 17:11:03.774776 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: Accept-Encoding: gzip, deflate May 23 17:11:03.774776 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: Connection: keep-alive May 23 17:11:03.774776 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: Content-Length: 0 May 23 17:11:03.774776 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: Host: 10.222.0.46 May 23 17:11:03.774776 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: Openstack-Api-Version: compute 2.90 May 23 17:11:03.774776 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: Openstack-System-Scope: None May 23 17:11:03.774776 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: User-Agent: python-novaclient May 23 17:11:03.774776 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Auth-Token: gAAAAABii8An1Vzi5eiH8f0Fz5uJpB0xzxbjSQx-_Nqotj8nVCgr4Z9tESJjBpjJcHPF6YEn8rhQhHWWnNEQ4t9zbW6WNUpIqlSDZvgG99kCc3OUdVSo3L5Qd9K0Sq7qGASruNducyetKzMXhuClQPqUcGO9wsKB5LUmOTpykx0S-bijB7JV7oU May 23 17:11:03.774776 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Domain-Id: None May 23 17:11:03.774776 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Domain-Name: None May 23 17:11:03.774776 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Identity-Status: Confirmed May 23 17:11:03.774776 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Is-Admin-Project: True May 23 17:11:03.774776 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Openstack-Nova-Api-Version: 2.90 May 23 17:11:03.774776 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Project-Domain-Id: default May 23 17:11:03.774776 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Project-Domain-Name: Default May 23 17:11:03.774776 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Project-Id: 549ef6c44d2245c896f7c092456b7282 May 23 17:11:03.774776 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Project-Name: admin May 23 17:11:03.774776 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Role: reader,member,admin May 23 17:11:03.774776 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Roles: reader,member,admin May 23 17:11:03.776423 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/549ef6c44d2245c896f7c092456b7282"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/549ef6c44d2245c896f7c092456b7282"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/549ef6c44d2245c896f7c092456b7282"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_549ef6c44d2245c896f7c092456b7282"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:11:03.776423 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Tenant: admin May 23 17:11:03.776423 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Tenant-Id: 549ef6c44d2245c896f7c092456b7282 May 23 17:11:03.776423 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Tenant-Name: admin May 23 17:11:03.776423 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-User: admin May 23 17:11:03.776423 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-User-Domain-Id: default May 23 17:11:03.776423 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-User-Domain-Name: Default May 23 17:11:03.776423 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-User-Id: eef11ad96d374697895a79e0a7fd9e82 May 23 17:11:03.776423 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-User-Name: admin May 23 17:11:03.776423 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: method: > May 23 17:11:03.776423 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: exception: Flavor 42 could not be found. May 23 17:11:03.776423 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: action_args: {'id': '42'} May 23 17:11:03.776423 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: {{(pid=103474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:11:03.776423 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:11:03.777414 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 17:11:03.777414 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 17:11:03.777414 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 17:11:03.777414 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 17:11:03.777414 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 17:11:03.777414 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 17:11:03.777414 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 17:11:03.777414 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 17:11:03.777414 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 17:11:03.777414 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:11:03.777414 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 17:11:03.777414 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 17:11:03.777414 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 23 17:11:03.777414 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi May 23 17:11:03.777414 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:11:03.777414 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi May 23 17:11:03.777414 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:11:03.777414 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:11:03.777414 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:11:03.778644 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:11:03.778644 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:11:03.778644 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:11:03.778644 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:11:03.778644 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 17:11:03.778644 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 17:11:03.778644 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 23 17:11:03.778644 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi May 23 17:11:03.778644 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:11:03.778644 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi May 23 17:11:03.778644 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:11:03.778644 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:11:03.778644 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:11:03.778644 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:11:03.778644 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:11:03.778644 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 23 17:11:03.778644 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi May 23 17:11:03.778644 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi [None req-7a15069e-21b5-46ff-a160-e179ddc46b3b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:11:03.779739 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO nova.api.openstack.requestlog [None req-7a15069e-21b5-46ff-a160-e179ddc46b3b admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.076041 May 23 17:11:03.779739 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: [pid: 103474|app: 0|req: 19/39] 10.222.0.46 () {60 vars in 1190 bytes} [Mon May 23 17:11:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 17:11:03.786250 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-49e9e24a-a1f9-4ce6-a1f7-2b62eb3daa3a admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:11:03.789339 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG dbcounter [-] [103475] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:11:03.808863 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-49e9e24a-a1f9-4ce6-a1f7-2b62eb3daa3a admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026170 May 23 17:11:03.809431 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 21/40] 10.222.0.46 () {60 vars in 1210 bytes} [Mon May 23 17:11:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:11:03.826020 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi [None req-249d31b1-ccb2-4246-a3db-aa853c72c9fd admin admin] Calling method '>' {{(pid=103474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:11:03.850558 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO nova.api.openstack.requestlog [None req-249d31b1-ccb2-4246-a3db-aa853c72c9fd admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028237 May 23 17:11:03.851139 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: [pid: 103474|app: 0|req: 20/41] 10.222.0.46 () {60 vars in 1210 bytes} [Mon May 23 17:11:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:11:03.861926 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-93f1dc47-fce9-4a44-9871-18a144d9bad4 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:11:03.868316 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.wsgi [None req-93f1dc47-fce9-4a44-9871-18a144d9bad4 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 23 17:11:03.871662 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-93f1dc47-fce9-4a44-9871-18a144d9bad4 admin admin] Request method failure captured: May 23 17:11:03.871662 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 23 17:11:03.871662 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: Accept: application/json May 23 17:11:03.871662 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: Accept-Encoding: gzip, deflate May 23 17:11:03.871662 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: Connection: keep-alive May 23 17:11:03.871662 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: Content-Length: 0 May 23 17:11:03.871662 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: Host: 10.222.0.46 May 23 17:11:03.871662 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: Openstack-Api-Version: compute 2.90 May 23 17:11:03.871662 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: Openstack-System-Scope: None May 23 17:11:03.871662 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: User-Agent: python-novaclient May 23 17:11:03.871662 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Auth-Token: gAAAAABii8An1Vzi5eiH8f0Fz5uJpB0xzxbjSQx-_Nqotj8nVCgr4Z9tESJjBpjJcHPF6YEn8rhQhHWWnNEQ4t9zbW6WNUpIqlSDZvgG99kCc3OUdVSo3L5Qd9K0Sq7qGASruNducyetKzMXhuClQPqUcGO9wsKB5LUmOTpykx0S-bijB7JV7oU May 23 17:11:03.871662 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Domain-Id: None May 23 17:11:03.871662 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Domain-Name: None May 23 17:11:03.871662 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Identity-Status: Confirmed May 23 17:11:03.871662 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Is-Admin-Project: True May 23 17:11:03.871662 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Openstack-Nova-Api-Version: 2.90 May 23 17:11:03.871662 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Project-Domain-Id: default May 23 17:11:03.871662 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Project-Domain-Name: Default May 23 17:11:03.871662 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Project-Id: 549ef6c44d2245c896f7c092456b7282 May 23 17:11:03.871662 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Project-Name: admin May 23 17:11:03.871662 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Role: reader,member,admin May 23 17:11:03.871662 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Roles: reader,member,admin May 23 17:11:03.873252 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/549ef6c44d2245c896f7c092456b7282"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/549ef6c44d2245c896f7c092456b7282"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/549ef6c44d2245c896f7c092456b7282"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_549ef6c44d2245c896f7c092456b7282"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:11:03.873252 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Tenant: admin May 23 17:11:03.873252 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Tenant-Id: 549ef6c44d2245c896f7c092456b7282 May 23 17:11:03.873252 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Tenant-Name: admin May 23 17:11:03.873252 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-User: admin May 23 17:11:03.873252 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-User-Domain-Id: default May 23 17:11:03.873252 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-User-Domain-Name: Default May 23 17:11:03.873252 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-User-Id: eef11ad96d374697895a79e0a7fd9e82 May 23 17:11:03.873252 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-User-Name: admin May 23 17:11:03.873252 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: method: > May 23 17:11:03.873252 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: exception: Flavor 42 could not be found. May 23 17:11:03.873252 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: action_args: {'id': '42'} May 23 17:11:03.873252 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:11:03.873252 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:11:03.874149 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 17:11:03.874149 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 17:11:03.874149 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 17:11:03.874149 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 17:11:03.874149 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 17:11:03.874149 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 17:11:03.874149 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 17:11:03.874149 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 17:11:03.874149 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 17:11:03.874149 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:11:03.874149 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 17:11:03.874149 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 17:11:03.874149 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 23 17:11:03.874149 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi May 23 17:11:03.874149 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:11:03.874149 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi May 23 17:11:03.874149 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:11:03.874149 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:11:03.874149 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:11:03.875560 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:11:03.875560 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:11:03.875560 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:11:03.875560 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:11:03.875560 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 17:11:03.875560 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 17:11:03.875560 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 23 17:11:03.875560 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi May 23 17:11:03.875560 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:11:03.875560 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi May 23 17:11:03.875560 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:11:03.875560 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:11:03.875560 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:11:03.875560 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:11:03.875560 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:11:03.875560 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 23 17:11:03.875560 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi May 23 17:11:03.875560 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-93f1dc47-fce9-4a44-9871-18a144d9bad4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:11:03.876863 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-93f1dc47-fce9-4a44-9871-18a144d9bad4 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015439 May 23 17:11:03.876863 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 22/42] 10.222.0.46 () {60 vars in 1190 bytes} [Mon May 23 17:11:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 17:11:04.758218 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi [None req-249d31b1-ccb2-4246-a3db-aa853c72c9fd admin admin] Calling method '>' {{(pid=103474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:11:04.759361 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO nova.api.openstack.requestlog [None req-249d31b1-ccb2-4246-a3db-aa853c72c9fd admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001601 May 23 17:11:04.759751 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: [pid: 103474|app: 0|req: 21/43] 10.222.0.46 () {56 vars in 1074 bytes} [Mon May 23 17:11:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:11:04.957542 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-7ebca64a-04bc-4f59-a1e2-92e4dad1eea6 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:11:04.963987 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.wsgi [None req-7ebca64a-04bc-4f59-a1e2-92e4dad1eea6 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 23 17:11:04.965475 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-7ebca64a-04bc-4f59-a1e2-92e4dad1eea6 admin admin] Request method failure captured: May 23 17:11:04.965475 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 23 17:11:04.965475 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: Accept: application/json May 23 17:11:04.965475 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: Accept-Encoding: gzip, deflate May 23 17:11:04.965475 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: Connection: keep-alive May 23 17:11:04.965475 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: Content-Length: 0 May 23 17:11:04.965475 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: Host: 10.222.0.46 May 23 17:11:04.965475 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: Openstack-Api-Version: compute 2.90 May 23 17:11:04.965475 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: Openstack-System-Scope: None May 23 17:11:04.965475 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: User-Agent: python-novaclient May 23 17:11:04.965475 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Auth-Token: gAAAAABii8Ao3mTbhm1HtUykwtea8SqNxo_s1pM0KPZeUKdQz5L_8Gbl1CP-YlhiT3EX7ywBPaBtL4BrRMK4p-vOwA1CO6RSBVRJz5H3YgicSz1PS275merX3j5yDhCew3A0R9nARmXjmv3hyCdgwdm2O718hCARwLM6TyVDBb8tBP6F9SHH6zA May 23 17:11:04.965475 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Domain-Id: None May 23 17:11:04.965475 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Domain-Name: None May 23 17:11:04.965475 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Identity-Status: Confirmed May 23 17:11:04.965475 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Is-Admin-Project: True May 23 17:11:04.965475 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Openstack-Nova-Api-Version: 2.90 May 23 17:11:04.965475 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Project-Domain-Id: default May 23 17:11:04.965475 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Project-Domain-Name: Default May 23 17:11:04.965475 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Project-Id: 549ef6c44d2245c896f7c092456b7282 May 23 17:11:04.965475 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Project-Name: admin May 23 17:11:04.965475 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Role: reader,member,admin May 23 17:11:04.965475 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Roles: reader,member,admin May 23 17:11:04.966951 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/549ef6c44d2245c896f7c092456b7282"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/549ef6c44d2245c896f7c092456b7282"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/549ef6c44d2245c896f7c092456b7282"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_549ef6c44d2245c896f7c092456b7282"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:11:04.966951 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Tenant: admin May 23 17:11:04.966951 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Tenant-Id: 549ef6c44d2245c896f7c092456b7282 May 23 17:11:04.966951 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Tenant-Name: admin May 23 17:11:04.966951 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-User: admin May 23 17:11:04.966951 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-User-Domain-Id: default May 23 17:11:04.966951 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-User-Domain-Name: Default May 23 17:11:04.966951 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-User-Id: eef11ad96d374697895a79e0a7fd9e82 May 23 17:11:04.966951 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-User-Name: admin May 23 17:11:04.966951 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: method: > May 23 17:11:04.966951 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: exception: Flavor 84 could not be found. May 23 17:11:04.966951 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: action_args: {'id': '84'} May 23 17:11:04.966951 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:11:04.966951 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:11:04.968238 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 17:11:04.968238 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 17:11:04.968238 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 17:11:04.968238 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 17:11:04.968238 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 17:11:04.968238 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 17:11:04.968238 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 17:11:04.968238 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 17:11:04.968238 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 17:11:04.968238 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:11:04.968238 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 17:11:04.968238 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 17:11:04.968238 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 23 17:11:04.968238 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi May 23 17:11:04.968238 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:11:04.968238 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi May 23 17:11:04.968238 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:11:04.968238 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:11:04.968238 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:11:04.969538 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:11:04.969538 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:11:04.969538 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:11:04.969538 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:11:04.969538 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 17:11:04.969538 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 17:11:04.969538 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 23 17:11:04.969538 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi May 23 17:11:04.969538 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:11:04.969538 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi May 23 17:11:04.969538 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:11:04.969538 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:11:04.969538 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:11:04.969538 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:11:04.969538 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:11:04.969538 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 23 17:11:04.969538 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi May 23 17:11:04.969538 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-7ebca64a-04bc-4f59-a1e2-92e4dad1eea6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:11:04.970798 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-7ebca64a-04bc-4f59-a1e2-92e4dad1eea6 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.071884 May 23 17:11:04.970798 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 23/44] 10.222.0.46 () {60 vars in 1190 bytes} [Mon May 23 17:11:04 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 17:11:04.976789 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi [None req-cb288407-2464-420e-b93a-33002d43646e admin admin] Calling method '>' {{(pid=103474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:11:04.993052 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO nova.api.openstack.requestlog [None req-cb288407-2464-420e-b93a-33002d43646e admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019917 May 23 17:11:04.993573 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: [pid: 103474|app: 0|req: 22/45] 10.222.0.46 () {60 vars in 1210 bytes} [Mon May 23 17:11:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:11:05.003086 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-9fe81095-346f-434e-ba6b-839bd37f3902 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:11:05.019190 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-9fe81095-346f-434e-ba6b-839bd37f3902 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019651 May 23 17:11:05.019721 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 24/46] 10.222.0.46 () {60 vars in 1210 bytes} [Mon May 23 17:11:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:11:05.031456 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi [None req-f94fb65d-8f6c-4f1a-9eb7-47aa01ae0b86 admin admin] Calling method '>' {{(pid=103474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:11:05.037300 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO nova.api.openstack.wsgi [None req-f94fb65d-8f6c-4f1a-9eb7-47aa01ae0b86 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 23 17:11:05.038810 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi [None req-f94fb65d-8f6c-4f1a-9eb7-47aa01ae0b86 admin admin] Request method failure captured: May 23 17:11:05.038810 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 23 17:11:05.038810 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: Accept: application/json May 23 17:11:05.038810 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: Accept-Encoding: gzip, deflate May 23 17:11:05.038810 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: Connection: keep-alive May 23 17:11:05.038810 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: Content-Length: 0 May 23 17:11:05.038810 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: Host: 10.222.0.46 May 23 17:11:05.038810 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: Openstack-Api-Version: compute 2.90 May 23 17:11:05.038810 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: Openstack-System-Scope: None May 23 17:11:05.038810 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: User-Agent: python-novaclient May 23 17:11:05.038810 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Auth-Token: gAAAAABii8Ao3mTbhm1HtUykwtea8SqNxo_s1pM0KPZeUKdQz5L_8Gbl1CP-YlhiT3EX7ywBPaBtL4BrRMK4p-vOwA1CO6RSBVRJz5H3YgicSz1PS275merX3j5yDhCew3A0R9nARmXjmv3hyCdgwdm2O718hCARwLM6TyVDBb8tBP6F9SHH6zA May 23 17:11:05.038810 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Domain-Id: None May 23 17:11:05.038810 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Domain-Name: None May 23 17:11:05.038810 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Identity-Status: Confirmed May 23 17:11:05.038810 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Is-Admin-Project: True May 23 17:11:05.038810 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Openstack-Nova-Api-Version: 2.90 May 23 17:11:05.038810 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Project-Domain-Id: default May 23 17:11:05.038810 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Project-Domain-Name: Default May 23 17:11:05.038810 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Project-Id: 549ef6c44d2245c896f7c092456b7282 May 23 17:11:05.038810 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Project-Name: admin May 23 17:11:05.038810 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Role: reader,member,admin May 23 17:11:05.038810 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Roles: reader,member,admin May 23 17:11:05.040180 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/549ef6c44d2245c896f7c092456b7282"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/549ef6c44d2245c896f7c092456b7282"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/549ef6c44d2245c896f7c092456b7282"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_549ef6c44d2245c896f7c092456b7282"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:11:05.040180 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Tenant: admin May 23 17:11:05.040180 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Tenant-Id: 549ef6c44d2245c896f7c092456b7282 May 23 17:11:05.040180 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Tenant-Name: admin May 23 17:11:05.040180 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-User: admin May 23 17:11:05.040180 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-User-Domain-Id: default May 23 17:11:05.040180 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-User-Domain-Name: Default May 23 17:11:05.040180 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-User-Id: eef11ad96d374697895a79e0a7fd9e82 May 23 17:11:05.040180 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-User-Name: admin May 23 17:11:05.040180 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: method: > May 23 17:11:05.040180 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: exception: Flavor 84 could not be found. May 23 17:11:05.040180 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: action_args: {'id': '84'} May 23 17:11:05.040180 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: {{(pid=103474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:11:05.040180 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:11:05.041003 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 17:11:05.041003 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 17:11:05.041003 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 17:11:05.041003 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 17:11:05.041003 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 17:11:05.041003 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 17:11:05.041003 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 17:11:05.041003 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 17:11:05.041003 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 17:11:05.041003 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:11:05.041003 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 17:11:05.041003 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 17:11:05.041003 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 23 17:11:05.041003 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi May 23 17:11:05.041003 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:11:05.041003 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi May 23 17:11:05.041003 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:11:05.041003 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:11:05.041003 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:11:05.042856 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:11:05.042856 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:11:05.042856 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:11:05.042856 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:11:05.042856 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 17:11:05.042856 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 17:11:05.042856 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 23 17:11:05.042856 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi May 23 17:11:05.042856 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:11:05.042856 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi May 23 17:11:05.042856 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:11:05.042856 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:11:05.042856 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:11:05.042856 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:11:05.042856 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:11:05.042856 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 23 17:11:05.042856 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi May 23 17:11:05.042856 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi [None req-f94fb65d-8f6c-4f1a-9eb7-47aa01ae0b86 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:11:05.044241 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO nova.api.openstack.requestlog [None req-f94fb65d-8f6c-4f1a-9eb7-47aa01ae0b86 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012345 May 23 17:11:05.044241 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: [pid: 103474|app: 0|req: 23/47] 10.222.0.46 () {60 vars in 1190 bytes} [Mon May 23 17:11:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 17:11:05.903340 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-9fe81095-346f-434e-ba6b-839bd37f3902 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:11:05.904447 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-9fe81095-346f-434e-ba6b-839bd37f3902 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 May 23 17:11:05.904880 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 25/48] 10.222.0.46 () {56 vars in 1074 bytes} [Mon May 23 17:11:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:11:06.107356 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi [None req-0bcb028e-7ea7-4e9d-9a11-4c05054b4532 admin admin] Calling method '>' {{(pid=103474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:11:06.113431 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO nova.api.openstack.wsgi [None req-0bcb028e-7ea7-4e9d-9a11-4c05054b4532 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 23 17:11:06.114950 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi [None req-0bcb028e-7ea7-4e9d-9a11-4c05054b4532 admin admin] Request method failure captured: May 23 17:11:06.114950 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 23 17:11:06.114950 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: Accept: application/json May 23 17:11:06.114950 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: Accept-Encoding: gzip, deflate May 23 17:11:06.114950 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: Connection: keep-alive May 23 17:11:06.114950 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: Content-Length: 0 May 23 17:11:06.114950 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: Host: 10.222.0.46 May 23 17:11:06.114950 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: Openstack-Api-Version: compute 2.90 May 23 17:11:06.114950 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: Openstack-System-Scope: None May 23 17:11:06.114950 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: User-Agent: python-novaclient May 23 17:11:06.114950 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Auth-Token: gAAAAABii8ApGCvkILQMV-8h_A8OoXMw-mGp4UoZZVfXONfVs8ma91QOO8Qx31twhvgYLoqEZCYXo6Bob1hwYu5PjdLz5b-HsWZ78ItyhkRd4Yrx-iEdZiXwgr5FXu5youInUkYaXYijVPUXvHQrwhDQDmhmAOdU6NZgzmDaZWfbLU1638BGuMc May 23 17:11:06.114950 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Domain-Id: None May 23 17:11:06.114950 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Domain-Name: None May 23 17:11:06.114950 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Identity-Status: Confirmed May 23 17:11:06.114950 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Is-Admin-Project: True May 23 17:11:06.114950 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Openstack-Nova-Api-Version: 2.90 May 23 17:11:06.114950 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Project-Domain-Id: default May 23 17:11:06.114950 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Project-Domain-Name: Default May 23 17:11:06.114950 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Project-Id: 549ef6c44d2245c896f7c092456b7282 May 23 17:11:06.114950 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Project-Name: admin May 23 17:11:06.114950 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Role: reader,member,admin May 23 17:11:06.114950 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Roles: reader,member,admin May 23 17:11:06.116328 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/549ef6c44d2245c896f7c092456b7282"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/549ef6c44d2245c896f7c092456b7282"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/549ef6c44d2245c896f7c092456b7282"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_549ef6c44d2245c896f7c092456b7282"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:11:06.116328 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Tenant: admin May 23 17:11:06.116328 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Tenant-Id: 549ef6c44d2245c896f7c092456b7282 May 23 17:11:06.116328 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-Tenant-Name: admin May 23 17:11:06.116328 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-User: admin May 23 17:11:06.116328 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-User-Domain-Id: default May 23 17:11:06.116328 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-User-Domain-Name: Default May 23 17:11:06.116328 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-User-Id: eef11ad96d374697895a79e0a7fd9e82 May 23 17:11:06.116328 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: X-User-Name: admin May 23 17:11:06.116328 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: method: > May 23 17:11:06.116328 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: exception: Flavor 451 could not be found. May 23 17:11:06.116328 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: action_args: {'id': '451'} May 23 17:11:06.116328 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: {{(pid=103474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:11:06.116328 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:11:06.117188 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 17:11:06.117188 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 17:11:06.117188 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 17:11:06.117188 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 17:11:06.117188 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 17:11:06.117188 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 17:11:06.117188 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 17:11:06.117188 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 17:11:06.117188 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 17:11:06.117188 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:11:06.117188 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 17:11:06.117188 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 17:11:06.117188 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 23 17:11:06.117188 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi May 23 17:11:06.117188 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:11:06.117188 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi May 23 17:11:06.117188 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:11:06.117188 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:11:06.117188 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:11:06.118278 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:11:06.118278 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:11:06.118278 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:11:06.118278 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:11:06.118278 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 17:11:06.118278 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 17:11:06.118278 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 23 17:11:06.118278 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi May 23 17:11:06.118278 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:11:06.118278 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi May 23 17:11:06.118278 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:11:06.118278 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:11:06.118278 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:11:06.118278 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:11:06.118278 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:11:06.118278 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 23 17:11:06.118278 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: ERROR nova.api.openstack.wsgi May 23 17:11:06.118278 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi [None req-0bcb028e-7ea7-4e9d-9a11-4c05054b4532 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:11:06.119302 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO nova.api.openstack.requestlog [None req-0bcb028e-7ea7-4e9d-9a11-4c05054b4532 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.075963 May 23 17:11:06.119302 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: [pid: 103474|app: 0|req: 24/49] 10.222.0.46 () {60 vars in 1193 bytes} [Mon May 23 17:11:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 17:11:06.126593 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-c86ea4c7-206a-4ef2-a4ca-0bada50d3388 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:11:06.141006 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-c86ea4c7-206a-4ef2-a4ca-0bada50d3388 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018262 May 23 17:11:06.141572 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 26/50] 10.222.0.46 () {60 vars in 1210 bytes} [Mon May 23 17:11:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:11:06.151364 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi [None req-92fc4a9f-c3d7-442b-9076-3ec9e1def679 admin admin] Calling method '>' {{(pid=103474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:11:06.165488 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO nova.api.openstack.requestlog [None req-92fc4a9f-c3d7-442b-9076-3ec9e1def679 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017796 May 23 17:11:06.166010 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: [pid: 103474|app: 0|req: 25/51] 10.222.0.46 () {60 vars in 1210 bytes} [Mon May 23 17:11:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:11:06.178100 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-71d03dd2-f215-4b6c-bb6e-b9ff014446d6 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:11:06.183986 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.wsgi [None req-71d03dd2-f215-4b6c-bb6e-b9ff014446d6 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 23 17:11:06.185516 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-71d03dd2-f215-4b6c-bb6e-b9ff014446d6 admin admin] Request method failure captured: May 23 17:11:06.185516 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 23 17:11:06.185516 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: Accept: application/json May 23 17:11:06.185516 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: Accept-Encoding: gzip, deflate May 23 17:11:06.185516 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: Connection: keep-alive May 23 17:11:06.185516 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: Content-Length: 0 May 23 17:11:06.185516 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: Host: 10.222.0.46 May 23 17:11:06.185516 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: Openstack-Api-Version: compute 2.90 May 23 17:11:06.185516 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: Openstack-System-Scope: None May 23 17:11:06.185516 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: User-Agent: python-novaclient May 23 17:11:06.185516 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Auth-Token: gAAAAABii8ApGCvkILQMV-8h_A8OoXMw-mGp4UoZZVfXONfVs8ma91QOO8Qx31twhvgYLoqEZCYXo6Bob1hwYu5PjdLz5b-HsWZ78ItyhkRd4Yrx-iEdZiXwgr5FXu5youInUkYaXYijVPUXvHQrwhDQDmhmAOdU6NZgzmDaZWfbLU1638BGuMc May 23 17:11:06.185516 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Domain-Id: None May 23 17:11:06.185516 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Domain-Name: None May 23 17:11:06.185516 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Identity-Status: Confirmed May 23 17:11:06.185516 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Is-Admin-Project: True May 23 17:11:06.185516 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Openstack-Nova-Api-Version: 2.90 May 23 17:11:06.185516 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Project-Domain-Id: default May 23 17:11:06.185516 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Project-Domain-Name: Default May 23 17:11:06.185516 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Project-Id: 549ef6c44d2245c896f7c092456b7282 May 23 17:11:06.185516 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Project-Name: admin May 23 17:11:06.185516 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Role: reader,member,admin May 23 17:11:06.185516 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Roles: reader,member,admin May 23 17:11:06.187120 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/549ef6c44d2245c896f7c092456b7282"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/549ef6c44d2245c896f7c092456b7282"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/549ef6c44d2245c896f7c092456b7282"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_549ef6c44d2245c896f7c092456b7282"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:11:06.187120 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Tenant: admin May 23 17:11:06.187120 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Tenant-Id: 549ef6c44d2245c896f7c092456b7282 May 23 17:11:06.187120 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-Tenant-Name: admin May 23 17:11:06.187120 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-User: admin May 23 17:11:06.187120 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-User-Domain-Id: default May 23 17:11:06.187120 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-User-Domain-Name: Default May 23 17:11:06.187120 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-User-Id: eef11ad96d374697895a79e0a7fd9e82 May 23 17:11:06.187120 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: X-User-Name: admin May 23 17:11:06.187120 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: method: > May 23 17:11:06.187120 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: exception: Flavor 451 could not be found. May 23 17:11:06.187120 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: action_args: {'id': '451'} May 23 17:11:06.187120 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:11:06.187120 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:11:06.188658 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 17:11:06.188658 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 17:11:06.188658 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 17:11:06.188658 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 17:11:06.188658 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 17:11:06.188658 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 17:11:06.188658 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 17:11:06.188658 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 17:11:06.188658 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 17:11:06.188658 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:11:06.188658 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 17:11:06.188658 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 17:11:06.188658 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 23 17:11:06.188658 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi May 23 17:11:06.188658 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:11:06.188658 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi May 23 17:11:06.188658 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:11:06.188658 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:11:06.188658 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:11:06.190794 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:11:06.190794 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:11:06.190794 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:11:06.190794 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:11:06.190794 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 17:11:06.190794 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 17:11:06.190794 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 23 17:11:06.190794 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi May 23 17:11:06.190794 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:11:06.190794 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi May 23 17:11:06.190794 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:11:06.190794 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:11:06.190794 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:11:06.190794 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:11:06.190794 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:11:06.190794 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 23 17:11:06.190794 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi May 23 17:11:06.190794 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-71d03dd2-f215-4b6c-bb6e-b9ff014446d6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:11:06.192574 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-71d03dd2-f215-4b6c-bb6e-b9ff014446d6 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012377 May 23 17:11:06.192574 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 27/52] 10.222.0.46 () {60 vars in 1193 bytes} [Mon May 23 17:11:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 17:11:07.051222 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi [None req-92fc4a9f-c3d7-442b-9076-3ec9e1def679 admin admin] Calling method '>' {{(pid=103474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:11:07.052642 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO nova.api.openstack.requestlog [None req-92fc4a9f-c3d7-442b-9076-3ec9e1def679 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002145 May 23 17:11:07.053055 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: [pid: 103474|app: 0|req: 26/53] 10.222.0.46 () {56 vars in 1074 bytes} [Mon May 23 17:11:07 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:11:07.254674 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-8c16c478-ddce-4dea-baa6-fcab313848ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:11:07.276169 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-8c16c478-ddce-4dea-baa6-fcab313848ca admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.086569 May 23 17:11:07.276725 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 28/54] 10.222.0.46 () {64 vars in 1235 bytes} [Mon May 23 17:11:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 17:11:08.148114 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi [None req-92fc4a9f-c3d7-442b-9076-3ec9e1def679 admin admin] Calling method '>' {{(pid=103474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:11:08.149203 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO nova.api.openstack.requestlog [None req-92fc4a9f-c3d7-442b-9076-3ec9e1def679 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 May 23 17:11:08.149593 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: [pid: 103474|app: 0|req: 27/55] 10.222.0.46 () {56 vars in 1074 bytes} [Mon May 23 17:11:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:11:08.348205 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-31938125-8b68-4696-8afc-5c93acb93ee5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:11:08.368021 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-31938125-8b68-4696-8afc-5c93acb93ee5 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.085028 May 23 17:11:08.368563 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 29/56] 10.222.0.46 () {64 vars in 1235 bytes} [Mon May 23 17:11:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 17:11:09.244347 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi [None req-92fc4a9f-c3d7-442b-9076-3ec9e1def679 admin admin] Calling method '>' {{(pid=103474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:11:09.245390 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO nova.api.openstack.requestlog [None req-92fc4a9f-c3d7-442b-9076-3ec9e1def679 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001580 May 23 17:11:09.245779 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: [pid: 103474|app: 0|req: 28/57] 10.222.0.46 () {56 vars in 1074 bytes} [Mon May 23 17:11:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:11:09.447777 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-9f6ee610-ba60-428a-a555-e250b908fafc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:11:09.468354 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-9f6ee610-ba60-428a-a555-e250b908fafc admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.089022 May 23 17:11:09.468965 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 30/58] 10.222.0.46 () {64 vars in 1235 bytes} [Mon May 23 17:11:09 2022] POST /compute/v2.1/flavors => generated 407 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 17:11:10.331863 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi [None req-92fc4a9f-c3d7-442b-9076-3ec9e1def679 admin admin] Calling method '>' {{(pid=103474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:11:10.333277 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO nova.api.openstack.requestlog [None req-92fc4a9f-c3d7-442b-9076-3ec9e1def679 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001952 May 23 17:11:10.333765 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: [pid: 103474|app: 0|req: 29/59] 10.222.0.46 () {56 vars in 1074 bytes} [Mon May 23 17:11:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:11:10.541549 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-e2acd64e-c293-414b-a07a-355a5fa01966 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:11:10.563471 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-e2acd64e-c293-414b-a07a-355a5fa01966 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.085189 May 23 17:11:10.564020 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 31/60] 10.222.0.46 () {64 vars in 1235 bytes} [Mon May 23 17:11:10 2022] POST /compute/v2.1/flavors => generated 409 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 17:11:11.443066 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi [None req-92fc4a9f-c3d7-442b-9076-3ec9e1def679 admin admin] Calling method '>' {{(pid=103474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:11:11.444084 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO nova.api.openstack.requestlog [None req-92fc4a9f-c3d7-442b-9076-3ec9e1def679 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 May 23 17:11:11.444463 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: [pid: 103474|app: 0|req: 30/61] 10.222.0.46 () {56 vars in 1074 bytes} [Mon May 23 17:11:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:11:11.648189 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-3ae5f11b-a748-4ea6-abe4-c7f6ed108e93 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:11:11.675043 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-3ae5f11b-a748-4ea6-abe4-c7f6ed108e93 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.094615 May 23 17:11:11.675603 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 32/62] 10.222.0.46 () {60 vars in 1202 bytes} [Mon May 23 17:11:11 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:12:13.218406 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi [None req-92fc4a9f-c3d7-442b-9076-3ec9e1def679 admin admin] Calling method '>' {{(pid=103474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:12:13.219458 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO nova.api.openstack.requestlog [None req-92fc4a9f-c3d7-442b-9076-3ec9e1def679 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 May 23 17:12:13.219844 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: [pid: 103474|app: 0|req: 31/63] 10.222.0.46 () {54 vars in 930 bytes} [Mon May 23 17:12:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:12:13.228384 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG dbcounter [-] [103475] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:12:13.285991 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-459813c6-31b1-4f3f-955d-247346ebba15 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:12:13.305123 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-459813c6-31b1-4f3f-955d-247346ebba15 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.078729 May 23 17:12:13.305660 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 33/64] 10.222.0.46 () {60 vars in 1291 bytes} [Mon May 23 17:12:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:12:13.338073 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG dbcounter [-] [103474] Writing DB stats nova_api:SELECT=14 {{(pid=103474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:12:13.342147 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi [None req-0bd6faa0-6740-4087-a039-2de34a2f6da1 admin admin] Calling method '>' {{(pid=103474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:12:13.350217 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO nova.api.openstack.requestlog [None req-0bd6faa0-6740-4087-a039-2de34a2f6da1 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014268 May 23 17:12:13.350725 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: [pid: 103474|app: 0|req: 32/65] 10.222.0.46 () {60 vars in 1282 bytes} [Mon May 23 17:12:13 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:12:13.362485 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-a0f43b18-207a-4ca4-9223-5001ff270f79 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:12:13.370896 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-a0f43b18-207a-4ca4-9223-5001ff270f79 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012088 May 23 17:12:13.371433 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 34/66] 10.222.0.46 () {60 vars in 1285 bytes} [Mon May 23 17:12:13 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:12:13.382877 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi [None req-121c60a1-5a3f-49a9-b5fc-4f57cab620d1 admin admin] Calling method '>' {{(pid=103474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:12:13.390971 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO nova.api.openstack.requestlog [None req-121c60a1-5a3f-49a9-b5fc-4f57cab620d1 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011706 May 23 17:12:13.391491 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: [pid: 103474|app: 0|req: 33/67] 10.222.0.46 () {60 vars in 1285 bytes} [Mon May 23 17:12:13 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:12:13.406498 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-240a46eb-10c8-4a76-a80b-77210d59d067 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:12:13.415741 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-240a46eb-10c8-4a76-a80b-77210d59d067 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014751 May 23 17:12:13.416280 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 35/68] 10.222.0.46 () {60 vars in 1282 bytes} [Mon May 23 17:12:13 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:15:41.572063 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi [None req-121c60a1-5a3f-49a9-b5fc-4f57cab620d1 admin admin] Calling method '>' {{(pid=103474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:15:41.573108 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO nova.api.openstack.requestlog [None req-121c60a1-5a3f-49a9-b5fc-4f57cab620d1 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 May 23 17:15:41.573491 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: [pid: 103474|app: 0|req: 34/69] 10.222.0.46 () {56 vars in 1074 bytes} [Mon May 23 17:15:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:15:41.726832 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG dbcounter [-] [103475] Writing DB stats nova_api:SELECT=6 {{(pid=103475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:41.849104 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-83b594f1-067a-41ec-90d9-59216e990838 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:15:41.850278 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 17:15:41.850278 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: warnings.warn(msg) May 23 17:15:41.851483 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-83b594f1-067a-41ec-90d9-59216e990838 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:15:41.851920 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-83b594f1-067a-41ec-90d9-59216e990838 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:15:41.852749 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-83b594f1-067a-41ec-90d9-59216e990838 admin admin] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:15:41.853176 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-83b594f1-067a-41ec-90d9-59216e990838 admin admin] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:15:41.885933 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-83b594f1-067a-41ec-90d9-59216e990838 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.160711 May 23 17:15:41.886497 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 36/70] 10.222.0.46 () {60 vars in 1193 bytes} [Mon May 23 17:15:41 2022] GET /compute/v2.1/os-services => generated 791 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 17:15:42.778929 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi [None req-121c60a1-5a3f-49a9-b5fc-4f57cab620d1 admin admin] Calling method '>' {{(pid=103474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:15:42.780031 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO nova.api.openstack.requestlog [None req-121c60a1-5a3f-49a9-b5fc-4f57cab620d1 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 May 23 17:15:42.780488 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: [pid: 103474|app: 0|req: 35/71] 10.222.0.46 () {56 vars in 1074 bytes} [Mon May 23 17:15:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:15:42.971017 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-3d2b77eb-c593-4651-8404-840f320772dd admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:15:42.972190 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 17:15:42.972190 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: warnings.warn(msg) May 23 17:15:42.973424 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-3d2b77eb-c593-4651-8404-840f320772dd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:15:42.973870 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-3d2b77eb-c593-4651-8404-840f320772dd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:15:42.974655 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-3d2b77eb-c593-4651-8404-840f320772dd admin admin] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:15:42.975089 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-3d2b77eb-c593-4651-8404-840f320772dd admin admin] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:15:42.994629 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-3d2b77eb-c593-4651-8404-840f320772dd admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076325 May 23 17:15:42.995173 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 37/72] 10.222.0.46 () {60 vars in 1193 bytes} [Mon May 23 17:15:42 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 17:15:54.323788 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi [None req-121c60a1-5a3f-49a9-b5fc-4f57cab620d1 admin admin] Calling method '>' {{(pid=103474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:15:54.324846 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO nova.api.openstack.requestlog [None req-121c60a1-5a3f-49a9-b5fc-4f57cab620d1 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 May 23 17:15:54.325238 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: [pid: 103474|app: 0|req: 36/73] 10.222.0.46 () {56 vars in 1074 bytes} [Mon May 23 17:15:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:15:54.470748 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG dbcounter [-] [103475] Writing DB stats nova_cell0:SELECT=4 {{(pid=103475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:54.471870 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG dbcounter [-] [103475] Writing DB stats nova_cell1:SELECT=4 {{(pid=103475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:54.472799 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG dbcounter [-] [103475] Writing DB stats nova_api:SELECT=8 {{(pid=103475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:15:54.526106 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-400879e3-dd81-478c-958f-5dedae599d80 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:15:54.527218 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 17:15:54.527218 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: warnings.warn(msg) May 23 17:15:54.528431 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-400879e3-dd81-478c-958f-5dedae599d80 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:15:54.528899 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-400879e3-dd81-478c-958f-5dedae599d80 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:15:54.529688 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-400879e3-dd81-478c-958f-5dedae599d80 admin admin] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:15:54.530115 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-400879e3-dd81-478c-958f-5dedae599d80 admin admin] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:15:54.554814 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-400879e3-dd81-478c-958f-5dedae599d80 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.091498 May 23 17:15:54.555563 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 38/74] 10.222.0.46 () {60 vars in 1193 bytes} [Mon May 23 17:15:54 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:15:55.429175 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: DEBUG nova.api.openstack.wsgi [None req-121c60a1-5a3f-49a9-b5fc-4f57cab620d1 admin admin] Calling method '>' {{(pid=103474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:15:55.430299 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: INFO nova.api.openstack.requestlog [None req-121c60a1-5a3f-49a9-b5fc-4f57cab620d1 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001594 May 23 17:15:55.430700 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: [pid: 103474|app: 0|req: 37/75] 10.222.0.46 () {56 vars in 1074 bytes} [Mon May 23 17:15:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:15:55.623838 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-fb9a76cb-e710-400f-a3ba-72fe44836197 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:15:55.625042 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 17:15:55.625042 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: warnings.warn(msg) May 23 17:15:55.626246 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-fb9a76cb-e710-400f-a3ba-72fe44836197 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:15:55.626736 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-fb9a76cb-e710-400f-a3ba-72fe44836197 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:15:55.627477 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-fb9a76cb-e710-400f-a3ba-72fe44836197 admin admin] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:15:55.627905 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-fb9a76cb-e710-400f-a3ba-72fe44836197 admin admin] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:15:55.650253 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-fb9a76cb-e710-400f-a3ba-72fe44836197 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083027 May 23 17:15:55.650796 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 39/76] 10.222.0.46 () {60 vars in 1193 bytes} [Mon May 23 17:15:55 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:16:52.678097 dv-cinder-842998-1-iscsi devstack@n-api.service[103473]: Mon May 23 17:16:52 2022 - graceful shutdown triggered... May 23 17:16:52.678865 dv-cinder-842998-1-iscsi devstack@n-api.service[103474]: Gracefully killing worker 1 (pid: 103474)... May 23 17:16:52.679599 dv-cinder-842998-1-iscsi devstack@n-api.service[103475]: Gracefully killing worker 2 (pid: 103475)... May 23 17:16:52.679013 dv-cinder-842998-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 23 17:16:53.680028 dv-cinder-842998-1-iscsi devstack@n-api.service[103473]: worker 1 buried after 1 seconds May 23 17:16:53.680028 dv-cinder-842998-1-iscsi devstack@n-api.service[103473]: worker 2 buried after 1 seconds May 23 17:16:53.680028 dv-cinder-842998-1-iscsi devstack@n-api.service[103473]: goodbye to uWSGI. May 23 17:16:53.682675 dv-cinder-842998-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 23 17:16:53.683615 dv-cinder-842998-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 23 17:16:53.687689 dv-cinder-842998-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 23 17:16:53.704196 dv-cinder-842998-1-iscsi devstack@n-api.service[117892]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 23 17:16:53.732156 dv-cinder-842998-1-iscsi devstack@n-api.service[117892]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 23 17:16:53 2022] *** May 23 17:16:53.732156 dv-cinder-842998-1-iscsi devstack@n-api.service[117892]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 23 17:16:53.732156 dv-cinder-842998-1-iscsi devstack@n-api.service[117892]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 23 17:16:53.732156 dv-cinder-842998-1-iscsi devstack@n-api.service[117892]: nodename: dv-cinder-842998-1-iscsi May 23 17:16:53.732156 dv-cinder-842998-1-iscsi devstack@n-api.service[117892]: machine: x86_64 May 23 17:16:53.732156 dv-cinder-842998-1-iscsi devstack@n-api.service[117892]: clock source: unix May 23 17:16:53.732156 dv-cinder-842998-1-iscsi devstack@n-api.service[117892]: pcre jit disabled May 23 17:16:53.732156 dv-cinder-842998-1-iscsi devstack@n-api.service[117892]: detected number of CPU cores: 4 May 23 17:16:53.732156 dv-cinder-842998-1-iscsi devstack@n-api.service[117892]: current working directory: / May 23 17:16:53.732156 dv-cinder-842998-1-iscsi devstack@n-api.service[117892]: detected binary path: /usr/bin/uwsgi-core May 23 17:16:53.732156 dv-cinder-842998-1-iscsi devstack@n-api.service[117892]: your processes number limit is 47680 May 23 17:16:53.732156 dv-cinder-842998-1-iscsi devstack@n-api.service[117892]: your memory page size is 4096 bytes May 23 17:16:53.732156 dv-cinder-842998-1-iscsi devstack@n-api.service[117892]: detected max file descriptor number: 2048 May 23 17:16:53.732156 dv-cinder-842998-1-iscsi devstack@n-api.service[117892]: lock engine: pthread robust mutexes May 23 17:16:53.733264 dv-cinder-842998-1-iscsi devstack@n-api.service[117892]: thunder lock: enabled May 23 17:16:53.733264 dv-cinder-842998-1-iscsi devstack@n-api.service[117892]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 23 17:16:53.733264 dv-cinder-842998-1-iscsi devstack@n-api.service[117892]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 23 17:16:53.777262 dv-cinder-842998-1-iscsi devstack@n-api.service[117892]: Python main interpreter initialized at 0x555e876849c0 May 23 17:16:53.777262 dv-cinder-842998-1-iscsi devstack@n-api.service[117892]: python threads support enabled May 23 17:16:53.777262 dv-cinder-842998-1-iscsi devstack@n-api.service[117892]: your server socket listen backlog is limited to 100 connections May 23 17:16:53.777262 dv-cinder-842998-1-iscsi devstack@n-api.service[117892]: your mercy for graceful operations on workers is 90 seconds May 23 17:16:53.777702 dv-cinder-842998-1-iscsi devstack@n-api.service[117892]: mapped 403077 bytes (393 KB) for 2 cores May 23 17:16:53.777702 dv-cinder-842998-1-iscsi devstack@n-api.service[117892]: *** Operational MODE: preforking *** May 23 17:16:53.777941 dv-cinder-842998-1-iscsi devstack@n-api.service[117892]: *** uWSGI is running in multiple interpreter mode *** May 23 17:16:53.777941 dv-cinder-842998-1-iscsi devstack@n-api.service[117892]: spawned uWSGI master process (pid: 117892) May 23 17:16:53.778155 dv-cinder-842998-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 23 17:16:53.778877 dv-cinder-842998-1-iscsi devstack@n-api.service[117892]: spawned uWSGI worker 1 (pid: 117909, cores: 1) May 23 17:16:53.779092 dv-cinder-842998-1-iscsi devstack@n-api.service[117892]: spawned uWSGI worker 2 (pid: 117910, cores: 1) May 23 17:16:53.779256 dv-cinder-842998-1-iscsi devstack@n-api.service[117892]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 23 17:16:54.951685 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 23 17:16:54.952362 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 23 17:16:55.732942 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 17:16:55.732942 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: from cryptography.utils import int_from_bytes May 23 17:16:55.732942 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 17:16:55.732942 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: from cryptography.utils import int_from_bytes May 23 17:16:55.733259 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 17:16:55.733259 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: from cryptography.utils import int_from_bytes May 23 17:16:55.733259 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 17:16:55.733259 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: from cryptography.utils import int_from_bytes May 23 17:16:58.152479 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 17:16:58.153117 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 17:16:58.153415 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 17:16:58.153657 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 17:16:58.153948 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 17:16:58.154308 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.154639 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.154998 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.155321 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.155698 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.156013 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.156336 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.156653 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.157176 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.157630 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.157955 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.158287 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842998-1-iscsi {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.158616 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.158941 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.159262 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.159586 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.159898 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.160221 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.160537 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.161076 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.162461 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.162461 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.162461 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.162848 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.163088 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.163403 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.163728 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.164056 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.164375 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.164711 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.165118 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842998-1-iscsi {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.165387 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 17:16:58.165810 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.165893 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 17:16:58.165966 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.166047 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.166274 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 17:16:58.166493 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.166612 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 17:16:58.166816 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 17:16:58.167032 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.167280 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.167478 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.167681 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.167893 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.168102 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.168311 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.168524 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.168743 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.168958 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.169161 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.169333 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.169519 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.169710 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.169867 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.170018 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.170195 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.170337 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.170491 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.170654 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.170832 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.171007 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.171210 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.171365 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.171533 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842998-1-iscsi {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.171676 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.171825 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.171977 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.172158 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.172305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.172467 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.172641 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.172801 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.172950 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.173111 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.173262 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.173420 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.173581 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.173735 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.173884 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.173884 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.174180 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.174355 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.174502 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.174651 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.174854 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.175035 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.175204 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.175347 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.175896 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.176050 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.176191 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.176341 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.176490 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.176661 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.176817 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.176960 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.177099 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.177252 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.177401 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.177559 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.177709 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.177852 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.178011 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842998-1-iscsi {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.178161 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.178310 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.178463 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.178615 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.178756 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.178926 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.179080 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.179221 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.179380 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.179534 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.179689 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.179838 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.179989 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.180137 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.180277 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.180418 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.180576 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.180753 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.180908 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.181050 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.181190 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.181190 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.181496 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.181645 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.181793 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.181951 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.182094 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.182243 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.182399 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.182548 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.182700 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.182841 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.182980 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.183138 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.183298 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.183450 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.183598 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.183740 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.183879 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.184036 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.184187 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.184337 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.184487 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.184672 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.184821 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.184988 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.185135 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.185248 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.185368 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.185491 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.186076 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.186220 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.186360 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.186490 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.186490 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.186832 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.186965 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.187103 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.187243 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.187370 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.187503 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.187639 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.187780 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.187780 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.187780 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.188148 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.188310 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.188310 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.188564 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.188705 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.188705 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.188968 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.189096 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.189096 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.189349 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.189483 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.189620 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.189745 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.189879 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.190006 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.190142 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.190424 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.190643 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.190783 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.190911 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.191047 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.191323 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.191465 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.191651 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.191784 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.191955 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.192214 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.192353 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.192557 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.195338 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.195485 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.195628 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.196246 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.196394 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.196536 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.196697 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.196830 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.196967 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.197095 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.197221 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.197361 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.197500 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.197636 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.197764 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.197889 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.198014 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.198156 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.198156 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.198404 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.198537 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.198677 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.198806 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.198942 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.199078 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.199078 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.199335 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.199468 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.199609 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.199745 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.199882 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.200016 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.200016 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.200272 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.200408 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.200535 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.200711 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.200711 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.200967 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.201093 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.201228 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.201367 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.201367 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.201617 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.201742 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.201879 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.202016 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.202016 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.202245 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.202400 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.202400 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.202860 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.203030 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.203030 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.203030 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.203505 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.203632 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.203766 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.203902 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.204030 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.204201 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.204396 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.204862 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.205028 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.205028 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.205277 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.205412 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.205538 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.205668 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.206112 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.206358 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.206586 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.206715 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.206715 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.206979 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.207115 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.207251 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.207378 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.207545 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.207675 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.207864 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.208097 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.208241 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.208522 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.208823 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.208970 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.209173 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.209384 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.209523 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.210239 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.210382 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.210520 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.210656 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.210656 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.210914 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.211049 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.211176 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.211310 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.211526 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.211746 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.211958 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.212119 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.212437 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.212583 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.212793 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.212934 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.213118 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.213393 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.213529 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.213748 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.213894 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.214067 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.214220 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.214385 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.214654 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.214807 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.215185 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.215316 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.215443 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.215585 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.215722 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.215890 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.216351 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.216594 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.216835 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.216966 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.217093 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.217233 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.217371 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.217499 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.217499 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.217746 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.217898 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.218169 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.218308 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.218488 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.218618 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.218800 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.219048 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.219194 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.219427 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.219555 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.219738 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.219943 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.220084 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.220366 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.220505 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.220706 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.220848 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.221019 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.221277 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:16:58.221418 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.221625 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.221789 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.221945 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.222234 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.222379 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.222558 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.222736 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.222868 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.223163 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.223302 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.223489 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.223657 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.223790 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.224122 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.224260 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.224777 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.224909 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.225041 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.225301 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.225403 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.225576 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.225685 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.225983 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.226075 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.226309 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.226431 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.226624 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.226857 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.226968 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.227235 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.227342 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.227545 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.227709 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.227856 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.228143 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.228235 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.228465 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.228659 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.228800 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.229110 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.229213 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.229418 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.229595 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.229730 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.230032 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.230132 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.230359 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.230501 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.230668 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.230933 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.231034 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.231269 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.231434 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.231616 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.231877 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.231974 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.232263 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.232372 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.232636 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.232806 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.232958 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.233267 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.233367 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.233617 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.233767 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.233939 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.234223 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.234327 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.234558 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.234713 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.234874 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.235140 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.235245 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.235505 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.235607 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.235818 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.236142 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.236333 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.236516 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.236801 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.236944 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.237116 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.237293 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.237443 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.237722 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.237825 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.238059 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.238197 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.238403 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.238627 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.238730 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.239055 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.239144 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.239382 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.239517 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.239696 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.239947 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.240039 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.240314 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.240414 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.240661 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.240875 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.240978 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.241268 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.241369 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.241590 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.241776 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.241905 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.242202 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.242305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.242524 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.242675 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.242852 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.243102 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.243247 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.243476 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.243613 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.243786 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.243991 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.244134 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.244414 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.244543 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.244775 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.244918 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.245094 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.245444 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.245592 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.245732 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.245985 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.246086 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.246352 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.246448 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.246674 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.246929 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.247106 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.247295 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.247398 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.247610 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.247871 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.248003 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.248231 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.248360 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.248554 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.248820 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.248965 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.249301 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.249435 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.249643 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.249787 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.249954 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.250181 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.250318 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.250566 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.250702 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.250893 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.251069 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.251201 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.251494 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.251623 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.251912 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.252052 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.252279 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.252417 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.252590 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.252830 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.252974 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.253252 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.253357 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.253560 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.253761 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.253864 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.254166 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.254265 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.254517 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.254610 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.254834 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.255045 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.255156 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.255516 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.255628 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.255769 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.255927 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.256074 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.256354 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.256459 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.256808 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.256928 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.257152 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.257287 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.257480 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.257591 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.257888 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.257991 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.258113 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.258434 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.258542 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.258747 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.258973 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.259066 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.259369 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.259471 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.259698 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.259854 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.260015 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.260293 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.260383 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.260659 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.260800 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.260973 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.261218 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.261321 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.261600 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.261693 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.262035 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.262200 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.262453 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.262554 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.262845 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.262948 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.263169 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.263377 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.263479 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.264156 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.264262 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.264488 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.264643 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.264907 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.265077 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.265268 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.265495 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.265633 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.265925 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.266047 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.266251 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.266435 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.266548 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.266862 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.266974 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.267168 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.267306 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.267479 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.267724 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.267814 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.268092 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.268198 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.268401 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.268555 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.268753 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.268894 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.269074 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.269244 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.269389 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.269588 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.269710 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.269913 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.270018 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.270244 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.270343 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.270559 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.270657 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.270882 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.270982 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.271199 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.271297 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.271513 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.271619 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.271828 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.271929 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.272141 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.272240 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.272462 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.272556 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.272802 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.272904 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.273123 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.273218 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.273440 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.273530 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.273768 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.273868 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.274082 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.274190 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.274395 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.274484 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.274700 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.274801 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.275019 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.275112 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.275329 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.275418 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.275639 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.275741 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.275958 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.276053 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.276272 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.276375 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.276583 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.276786 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.277012 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.277107 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.277225 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.277330 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.277539 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.277632 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.277849 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.277948 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.278156 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.278261 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.278471 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.278605 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.278782 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.278874 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.279100 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.279205 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.279412 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.279505 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.279719 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.279839 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.280027 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.280128 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.280343 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.280486 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.280718 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.280818 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.281027 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.281123 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.281341 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.281440 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.281651 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.281743 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.281973 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.282076 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.282282 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.282373 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.282592 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.282685 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.282901 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.283002 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.283212 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.283302 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.283522 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.283622 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.283826 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.283925 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.284134 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.284235 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.284450 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.284557 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.284792 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.284899 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.285101 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.285192 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.285413 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.285515 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.285719 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.285818 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.286054 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.286168 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.286337 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.286444 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.286642 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.286742 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.287043 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.287181 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.287307 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.287428 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.287546 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.287677 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.287853 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.287945 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.288162 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.288305 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.288470 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.288563 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.288798 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.288890 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.289108 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.289203 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.289417 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.289516 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.289728 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.289821 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.290035 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.290129 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.290343 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.290435 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.290650 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.290754 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.290970 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.291069 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.291279 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.291380 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.291580 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.291681 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.291885 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.291980 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.292204 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.292294 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.292514 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.292718 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.292856 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.292949 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.293167 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.293268 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.293476 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.293579 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.293798 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.293898 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.294112 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.294206 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.294421 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.294550 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.294732 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.294848 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.295041 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.295141 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.295349 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.295441 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.295658 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.295759 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.295974 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.296096 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.296317 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.296455 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.296641 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.296760 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.296956 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.297270 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.297433 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.297566 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.297659 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.297799 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.297899 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.297993 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.298195 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.298434 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.298533 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.298770 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.298872 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.299085 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.299178 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.299406 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.299499 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.299726 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.299815 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.300042 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.300143 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.300355 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.300454 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.300700 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.300818 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.301034 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.301129 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.301352 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.301461 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.301667 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.301757 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.301974 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.302064 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.302278 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.302384 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.302589 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.302688 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.302895 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.302987 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.303199 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.303309 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.303503 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.303604 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.303815 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.303917 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.304121 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.304232 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.304425 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.304515 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.304752 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.304860 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.305061 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.305162 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.305370 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.305461 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.305676 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.305813 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.305989 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.306133 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.306304 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.306456 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.306630 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.306767 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.306938 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.307085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.307275 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.307387 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.307544 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.307708 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.307847 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.308027 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.308191 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.308338 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.308500 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.308800 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.308907 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.309119 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.309211 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.309436 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.309537 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.309753 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.309853 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.310066 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.310166 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.310376 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.310475 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.310694 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.310794 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.310997 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.311086 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.311305 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.311411 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.311618 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.311750 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.311977 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.312068 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.312294 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.312399 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.312623 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.312731 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.312938 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.313029 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.313248 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.313354 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.313558 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.313650 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.313860 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.313960 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.314171 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.314368 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.314471 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.314685 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.314776 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.315004 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.315110 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.315333 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.315425 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.315658 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.315748 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.315970 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.316070 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.316283 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.316374 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.316589 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.316734 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.316919 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.317028 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.317228 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.317345 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.317547 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.317658 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.317872 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.317986 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.318159 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.318252 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.318997 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.319077 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.319177 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.319264 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.319348 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.319429 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.319501 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.319580 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.319652 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.319737 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.319952 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.320127 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.320259 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.320457 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.320558 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.320801 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.320894 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.321129 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.321222 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.321460 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.321554 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.321767 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.321857 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.322080 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.322177 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.322391 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.322484 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.322723 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.322808 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.322987 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.323080 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.323293 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.323401 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.323591 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.323689 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.323887 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.323996 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.324194 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.324303 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.324495 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.324588 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.324823 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.324925 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.325128 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.325235 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.325432 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.325522 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.325736 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.325835 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.326058 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.326161 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.326374 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.326503 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.326681 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.326782 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.326987 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.327097 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.327313 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.327415 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.327648 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.327777 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.327963 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.328063 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.328277 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.328401 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.328585 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.328717 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.328921 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.329042 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.329274 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.329373 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.329588 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.329686 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.329914 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.330028 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.330252 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.330354 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.330558 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.330650 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.330879 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.330972 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.331192 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.331281 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.331504 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.331604 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.331809 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.331902 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.332115 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.332206 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.332438 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.332539 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.332773 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.332867 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.333084 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.333172 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.333399 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.333500 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.333710 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.333798 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.334022 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.334138 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.334325 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.334422 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.334634 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.334732 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.334942 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.335042 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.335246 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.335343 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.335552 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.335644 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.335860 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.335964 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.336170 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.336261 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.336487 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.336590 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.336823 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.336965 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.337137 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.337244 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.337442 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.337566 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.337748 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.337854 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.338058 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.338155 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.338369 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.338478 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.338677 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.338779 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.339017 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.339120 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.339315 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.339416 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.339621 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.339733 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.339933 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.340043 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.340240 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.340361 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.340583 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.340719 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.340878 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.340970 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.341233 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.341345 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.341554 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.341647 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.341874 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.341974 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.342196 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.342302 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.342504 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.342595 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.342815 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.342934 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.343189 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.343295 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.343510 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.343611 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.343818 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.343918 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.344239 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.344380 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.344556 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.344745 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.344900 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.345066 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.345239 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.345385 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.345508 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.345704 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.345815 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.346022 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.346341 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.346433 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.346656 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.346765 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.346975 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.347079 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.347290 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.347384 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.347605 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.347697 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.347931 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.348029 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.348246 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.348351 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.348571 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.348704 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.348938 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.349040 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.349266 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.349359 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.349588 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.349682 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.349910 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.350016 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.350229 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.350328 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.350591 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.350699 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.350911 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.351024 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.351220 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.351321 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.351537 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.351637 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.351844 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.351949 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.352161 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.352250 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.352472 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.352561 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.352812 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.352916 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.353129 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.353230 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.353441 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.353532 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.353754 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.353853 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.354060 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.354153 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.354373 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.354477 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.354695 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.354820 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.355007 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.355105 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.355328 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.355445 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.355653 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.355753 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.355971 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.356064 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.356290 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.356395 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.356745 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.356855 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.357072 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.357185 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.357305 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.357458 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.357611 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.357803 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.357968 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.358122 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.358286 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.358453 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.358630 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.358812 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.358957 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.359132 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.359286 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.359449 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.359588 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.359761 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.359900 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.360071 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.360242 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.360383 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.360528 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.360721 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.360822 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.361003 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.361097 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.361308 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.361408 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.361630 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.361731 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.361937 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.362037 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.362257 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.362347 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.362569 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.362658 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.362874 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.363114 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.363215 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.363472 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.363564 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.363782 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.363883 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.364088 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.364179 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.364393 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.364492 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.364757 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.364855 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.365067 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.365158 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.365390 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.365499 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.365698 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.365805 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.366012 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.366113 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.366333 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.366427 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.366648 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.366759 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.366958 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.367069 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.367270 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.367363 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.367587 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.367680 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.367899 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.367990 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.368207 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.368339 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.368513 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.368620 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.368846 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.368942 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.369153 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.369258 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.369458 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.369558 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.369765 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.369857 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.370075 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.370178 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.370380 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.370471 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.370685 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.370812 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.370988 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.371093 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.371298 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.371400 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.371601 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.371698 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.371915 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.372007 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.372222 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.372318 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.372527 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.372658 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.372860 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.372954 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.373163 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.373255 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.373470 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.373560 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.373786 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.373879 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.374136 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.374303 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.374519 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.374623 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.374831 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.374925 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.375139 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.375229 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.375458 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.375567 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.375773 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.375873 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.376088 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.376188 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.376404 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.376511 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.376741 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.376835 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.377059 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.377165 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.377374 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.377483 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.377690 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.377935 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.378071 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.378282 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.378382 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.378607 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.378701 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.378922 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.379025 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.379242 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.379347 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.379583 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.379777 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.379898 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.380108 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.380202 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.380425 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.380519 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.380761 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.380897 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.381077 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.381172 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.381392 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.381494 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.381704 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.381803 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.382014 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.382106 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.382325 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.382418 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.382636 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.382727 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.382947 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.383049 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.383274 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.383367 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.383586 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.383684 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.383902 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.384009 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.384219 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.384319 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.384537 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.384659 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.384879 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.384988 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.385194 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.385288 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.385507 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.385598 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.385840 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.385942 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.386164 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.386255 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.386469 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.386571 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.386783 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.386884 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.387098 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.387189 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.387409 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.387513 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.387719 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.387820 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.388029 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.388158 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.388341 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.388444 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.389034 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.389170 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.389344 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.389449 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.389653 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.389775 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.389989 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.390109 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.390300 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.390438 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.390626 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.390757 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.390962 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.391109 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.391279 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.391401 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.391593 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.391717 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.391905 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.392045 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.392221 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.392365 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.392734 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.392842 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.393067 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.393167 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.393398 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.393499 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.393722 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.393813 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.394031 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.394132 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.394342 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.394443 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.394651 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.394750 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.394964 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.395057 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.395268 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.395373 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.395570 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.395671 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.395885 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.395977 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.396190 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.396291 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.396494 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.396592 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.396890 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.397035 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.397145 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.397228 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.397440 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.397578 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.397747 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.397846 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.398057 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.398158 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.398362 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.398599 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.398693 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.398953 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.399060 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.399267 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.399379 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.399572 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.399665 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.399881 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.399987 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.400200 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.400301 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.400506 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.400655 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.400842 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.400935 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.401147 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.401251 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.401454 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.401554 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.401764 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.401868 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.402073 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.402171 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.402379 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.402469 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.402732 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.402833 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.402996 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.403098 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.403307 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.403407 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.403609 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.403703 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.403917 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.404008 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.404220 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.404392 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.404549 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.404660 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.404878 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.404974 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.405183 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.405290 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.405569 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.405664 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.405883 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.405983 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.406192 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.406300 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.406495 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.406588 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.406802 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.406901 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.407109 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.407215 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.407421 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.407523 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.407723 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.407826 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.408031 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.408132 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.408336 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.408436 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.408670 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.408784 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.408974 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.409068 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.409304 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.409439 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.409641 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.409740 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.409957 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.410049 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.410260 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.410350 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.410565 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.410668 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.410879 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.410972 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.411189 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.411317 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.411502 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.411604 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.411828 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.411971 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.412128 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.412243 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.412447 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.412547 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.412802 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.412885 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.413134 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.413339 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.413449 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.413681 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.413771 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.414006 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.414094 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.414526 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.414757 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.414898 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.415107 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.415233 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.415442 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.415567 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.415754 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.415880 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.416067 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.416183 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.416378 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.416511 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.416636 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 17:16:58.416741 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.417034 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.417348 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.417719 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.417975 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.418289 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.418604 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.418917 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.419230 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.419543 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.419853 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.420164 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.420483 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.420848 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.421310 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.421724 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.422080 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.422528 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.422697 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.423009 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.423322 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.423633 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.423951 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.424283 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.424621 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.424933 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.425358 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.425674 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.425998 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.426327 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.426639 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.426962 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.427289 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.427601 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.427927 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.428241 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.428572 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.428933 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.429262 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.429589 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.429902 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.430200 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.430508 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.430819 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.431136 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.431447 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.431752 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.432054 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.432366 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.432694 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.433000 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.433305 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.433610 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.433920 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.434222 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.434523 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.434827 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.435129 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.435431 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.435734 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.436044 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.436352 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.436778 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.437094 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.437398 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.437704 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.438039 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.438377 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.438697 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.439021 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.439330 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.439657 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.439966 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.440289 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.440632 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.440958 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.441269 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.441606 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.441919 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.442236 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.442551 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.442863 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.443177 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.443488 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.443816 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.444144 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.444452 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.444814 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.445136 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.445462 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.445781 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.446088 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.446422 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.446732 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.447320 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.447648 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.447962 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.448282 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.448621 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.448937 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.449265 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.449592 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.449904 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.450232 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.450563 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.450911 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.451225 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.451574 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.451904 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.452224 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.452583 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.452911 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:16:58.453154 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 17:16:58.475644 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO dbcounter [None req-ed5a168b-4322-435c-8b14-2d5884f064a0 None None] Registered counter for database nova_api May 23 17:16:58.495989 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_db.sqlalchemy.engines [None req-ed5a168b-4322-435c-8b14-2d5884f064a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117910) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 17:16:58.503875 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writer thread running {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 17:16:58.512773 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO dbcounter [None req-5cc245d2-48ce-4ebe-99ac-216a606308b1 None None] Registered counter for database nova_api May 23 17:16:58.537486 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_db.sqlalchemy.engines [None req-5cc245d2-48ce-4ebe-99ac-216a606308b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117909) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 17:16:58.546069 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writer thread running {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 17:16:58.564006 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.context [None req-ed5a168b-4322-435c-8b14-2d5884f064a0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),00a96999-6d6a-4eda-a805-882c38016a13(cell1) {{(pid=117910) load_cells /opt/stack/nova/nova/context.py:464}} May 23 17:16:58.568242 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ed5a168b-4322-435c-8b14-2d5884f064a0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:16:58.569884 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ed5a168b-4322-435c-8b14-2d5884f064a0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:16:58.570695 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ed5a168b-4322-435c-8b14-2d5884f064a0 None None] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:16:58.572799 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ed5a168b-4322-435c-8b14-2d5884f064a0 None None] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:16:58.574802 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO dbcounter [None req-ed5a168b-4322-435c-8b14-2d5884f064a0 None None] Registered counter for database nova_cell0 May 23 17:16:58.578963 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO dbcounter [None req-ed5a168b-4322-435c-8b14-2d5884f064a0 None None] Registered counter for database nova_cell1 May 23 17:16:58.586690 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_db.sqlalchemy.engines [None req-ed5a168b-4322-435c-8b14-2d5884f064a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117910) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 17:16:58.588423 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_db.sqlalchemy.engines [None req-ed5a168b-4322-435c-8b14-2d5884f064a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117910) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 17:16:58.593599 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writer thread running {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 17:16:58.599346 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writer thread running {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 17:16:58.602237 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.context [None req-5cc245d2-48ce-4ebe-99ac-216a606308b1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),00a96999-6d6a-4eda-a805-882c38016a13(cell1) {{(pid=117909) load_cells /opt/stack/nova/nova/context.py:464}} May 23 17:16:58.606428 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5cc245d2-48ce-4ebe-99ac-216a606308b1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:16:58.608031 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5cc245d2-48ce-4ebe-99ac-216a606308b1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:16:58.608903 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5cc245d2-48ce-4ebe-99ac-216a606308b1 None None] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:16:58.610991 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5cc245d2-48ce-4ebe-99ac-216a606308b1 None None] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:16:58.613354 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO dbcounter [None req-5cc245d2-48ce-4ebe-99ac-216a606308b1 None None] Registered counter for database nova_cell0 May 23 17:16:58.617333 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO dbcounter [None req-5cc245d2-48ce-4ebe-99ac-216a606308b1 None None] Registered counter for database nova_cell1 May 23 17:16:58.625096 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_db.sqlalchemy.engines [None req-5cc245d2-48ce-4ebe-99ac-216a606308b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117909) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 17:16:58.627373 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_db.sqlalchemy.engines [None req-5cc245d2-48ce-4ebe-99ac-216a606308b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117909) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 17:16:58.631718 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writer thread running {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 17:16:58.742308 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO dbcounter [None req-ed5a168b-4322-435c-8b14-2d5884f064a0 None None] Registered counter for database nova_cell0 May 23 17:16:58.749345 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_db.sqlalchemy.engines [None req-ed5a168b-4322-435c-8b14-2d5884f064a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117910) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 17:16:58.753894 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writer thread running {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 17:16:58.773063 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writer thread running {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 17:16:58.783372 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO dbcounter [None req-5cc245d2-48ce-4ebe-99ac-216a606308b1 None None] Registered counter for database nova_cell0 May 23 17:16:58.797227 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_db.sqlalchemy.engines [None req-5cc245d2-48ce-4ebe-99ac-216a606308b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117909) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 17:16:58.803623 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writer thread running {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 17:16:59.067240 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: WARNING keystonemiddleware.auth_token [None req-ed5a168b-4322-435c-8b14-2d5884f064a0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 17:16:59.074551 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: WARNING keystonemiddleware.auth_token [None req-ed5a168b-4322-435c-8b14-2d5884f064a0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 17:16:59.120011 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: WARNING keystonemiddleware.auth_token [None req-5cc245d2-48ce-4ebe-99ac-216a606308b1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 17:16:59.127962 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: WARNING keystonemiddleware.auth_token [None req-5cc245d2-48ce-4ebe-99ac-216a606308b1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 17:16:59.425795 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: WARNING keystonemiddleware.auth_token [None req-ed5a168b-4322-435c-8b14-2d5884f064a0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 17:16:59.431910 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: WARNING keystonemiddleware.auth_token [None req-ed5a168b-4322-435c-8b14-2d5884f064a0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 17:16:59.437367 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555e876849c0 pid: 117910 (default app) May 23 17:16:59.472554 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: WARNING keystonemiddleware.auth_token [None req-5cc245d2-48ce-4ebe-99ac-216a606308b1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 17:16:59.478721 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: WARNING keystonemiddleware.auth_token [None req-5cc245d2-48ce-4ebe-99ac-216a606308b1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 17:16:59.484054 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555e876849c0 pid: 117909 (default app) May 23 17:17:39.634780 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=3 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:39.637347 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=3 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:39.639277 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=3 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:39.640491 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=3 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:40.373540 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=3 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:40.374465 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=3 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:40.375532 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=3 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:40.376516 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=3 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:40.769038 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e13dabb9-13eb-4267-b9fb-e4cbad8076ee tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1711814291", "imageRef": "99870172-61a4-4218-9407-6a6da3fb5c83", "flavorRef": "452", "networks": [{"uuid": "7e56edb4-7660-4df2-8069-1523dc71f7a6"}]}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:17:41.668892 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-678a5770-454a-4fc2-ab10-5d4bd08c2647 tempest-VolumesGetTestJSON-1718843450 tempest-VolumesGetTestJSON-1718843450-project] Action: 'create', calling method: .version_select at 0x7fd7a1dd2c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1779744174", "metadata": {"Type": "work"}}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:17:42.164517 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.network.neutron [None req-e13dabb9-13eb-4267-b9fb-e4cbad8076ee tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] validate_networks() for [('7e56edb4-7660-4df2-8069-1523dc71f7a6', None, None, None, None, None)] {{(pid=117910) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 17:17:43.012626 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-678a5770-454a-4fc2-ab10-5d4bd08c2647 tempest-VolumesGetTestJSON-1718843450 tempest-VolumesGetTestJSON-1718843450-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.644331 May 23 17:17:43.013269 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1/1] 10.222.0.46 () {60 vars in 1155 bytes} [Mon May 23 17:17:40 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2647 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 23 17:17:43.456522 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7394e05b-abbb-42ef-8bd8-1c32d826a38a tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] Action: 'create', calling method: .version_select at 0x7fd7a1c1eaf0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1336097087"}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:17:43.600102 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-e13dabb9-13eb-4267-b9fb-e4cbad8076ee tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Flavor limits 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 17:17:43.601269 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-e13dabb9-13eb-4267-b9fb-e4cbad8076ee tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Image limits 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 17:17:43.602028 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-e13dabb9-13eb-4267-b9fb-e4cbad8076ee tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Flavor pref 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 17:17:43.602609 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-e13dabb9-13eb-4267-b9fb-e4cbad8076ee tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Image pref 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 17:17:43.603226 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-e13dabb9-13eb-4267-b9fb-e4cbad8076ee tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 17:17:43.631109 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e13dabb9-13eb-4267-b9fb-e4cbad8076ee tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:17:43.631711 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e13dabb9-13eb-4267-b9fb-e4cbad8076ee tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:17:43.633653 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e13dabb9-13eb-4267-b9fb-e4cbad8076ee tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:17:43.635291 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e13dabb9-13eb-4267-b9fb-e4cbad8076ee tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:17:43.754390 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-e13dabb9-13eb-4267-b9fb-e4cbad8076ee tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Getting quotas for project 9dd50da000f94eeca1c4f6ab9867d4d6. Resources: {'cores', 'instances', 'ram'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 17:17:43.778466 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-e13dabb9-13eb-4267-b9fb-e4cbad8076ee tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Getting quotas for user 0429f5d2715a4487a39281edbd941fbd and project 9dd50da000f94eeca1c4f6ab9867d4d6. Resources: {'cores', 'instances', 'ram'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 17:17:43.822117 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-e13dabb9-13eb-4267-b9fb-e4cbad8076ee tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Going to run 1 instances... {{(pid=117910) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 17:17:43.832487 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-e13dabb9-13eb-4267-b9fb-e4cbad8076ee tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] [instance: 531aeff0-e028-4f24-9d36-a48492b18414] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99870172-61a4-4218-9407-6a6da3fb5c83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117910) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 17:17:43.966747 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-e13dabb9-13eb-4267-b9fb-e4cbad8076ee tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.340961 May 23 17:17:43.967980 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 1/2] 10.222.0.46 () {60 vars in 1146 bytes} [Mon May 23 17:17:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 4345 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 17:17:43.974294 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b8d861bf-d4ec-4a62-90eb-7df9c7b9f14b tempest-VolumesTestJSON-582931929 tempest-VolumesTestJSON-582931929-project] Calling method '.version_select at 0x7fd7a1bcbb80>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:17:44.017201 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7394e05b-abbb-42ef-8bd8-1c32d826a38a tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.002089 May 23 17:17:44.018135 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 2/3] 10.222.0.46 () {60 vars in 1154 bytes} [Mon May 23 17:17:43 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1004 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 23 17:17:44.023321 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-cf9db7ff-634b-4657-be02-79434f0e6312 tempest-VolumesGetTestJSON-1718843450 tempest-VolumesGetTestJSON-1718843450-project] Calling method '.version_select at 0x7fd7a1c1ed30>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:17:44.123702 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b8d861bf-d4ec-4a62-90eb-7df9c7b9f14b tempest-VolumesTestJSON-582931929 tempest-VolumesTestJSON-582931929-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/0e064ae7-4c9b-4d74-b2dc-8fe775c8a5f4" status: 200 len: 350 microversion: 2.1 time: 0.153725 May 23 17:17:44.124814 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 2/4] 10.222.0.46 () {58 vars in 1244 bytes} [Mon May 23 17:17:43 2022] GET /compute/v2.1/os-volumes/0e064ae7-4c9b-4d74-b2dc-8fe775c8a5f4 => generated 350 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:17:44.130299 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-71e55a47-7031-4dc8-a960-4ad28e91d8d9 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:17:44.131230 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-71e55a47-7031-4dc8-a960-4ad28e91d8d9 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] [instance: 531aeff0-e028-4f24-9d36-a48492b18414] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:17:44.148931 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-cf9db7ff-634b-4657-be02-79434f0e6312 tempest-VolumesGetTestJSON-1718843450 tempest-VolumesGetTestJSON-1718843450-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/22e51e19-dae2-431b-8714-34111ec81ff3" status: 200 len: 354 microversion: 2.1 time: 0.129573 May 23 17:17:44.149500 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 3/5] 10.222.0.46 () {58 vars in 1244 bytes} [Mon May 23 17:17:44 2022] GET /compute/v2.1/os-volumes/22e51e19-dae2-431b-8714-34111ec81ff3 => generated 354 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:17:44.155096 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-84591b1a-0a72-493e-897c-e1c33528de77 tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] Calling method '.version_select at 0x7fd7a1c2e3a0>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:17:44.314288 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-84591b1a-0a72-493e-897c-e1c33528de77 tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/723be79d-d12c-4ed6-b296-dc60943132f7" status: 200 len: 345 microversion: 2.1 time: 0.162557 May 23 17:17:44.314868 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 4/6] 10.222.0.46 () {58 vars in 1244 bytes} [Mon May 23 17:17:44 2022] GET /compute/v2.1/os-volumes/723be79d-d12c-4ed6-b296-dc60943132f7 => generated 345 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:17:44.320171 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d9a95f54-245b-4af5-903b-a682989dce8f tempest-VolumesGetTestJSON-1718843450 tempest-VolumesGetTestJSON-1718843450-project] Calling method '.version_select at 0x7fd7a1c2ea60>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:17:44.487244 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d9a95f54-245b-4af5-903b-a682989dce8f tempest-VolumesGetTestJSON-1718843450 tempest-VolumesGetTestJSON-1718843450-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/22e51e19-dae2-431b-8714-34111ec81ff3" status: 200 len: 354 microversion: 2.1 time: 0.170873 May 23 17:17:44.488548 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 5/7] 10.222.0.46 () {58 vars in 1244 bytes} [Mon May 23 17:17:44 2022] GET /compute/v2.1/os-volumes/22e51e19-dae2-431b-8714-34111ec81ff3 => generated 354 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:17:44.510754 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7dbaf5c4-06cd-4333-aa34-3d6c97191051 tempest-VolumesGetTestJSON-1718843450 tempest-VolumesGetTestJSON-1718843450-project] Calling method '.version_select at 0x7fd7a1c2eb80>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:17:44.740578 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7dbaf5c4-06cd-4333-aa34-3d6c97191051 tempest-VolumesGetTestJSON-1718843450 tempest-VolumesGetTestJSON-1718843450-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/22e51e19-dae2-431b-8714-34111ec81ff3" status: 202 len: 0 microversion: 2.1 time: 0.237528 May 23 17:17:44.741437 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 6/8] 10.222.0.46 () {58 vars in 1247 bytes} [Mon May 23 17:17:44 2022] DELETE /compute/v2.1/os-volumes/22e51e19-dae2-431b-8714-34111ec81ff3 => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 17:17:44.752302 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d2ec6005-ee2c-4888-b254-5439d35f948d tempest-VolumesGetTestJSON-1718843450 tempest-VolumesGetTestJSON-1718843450-project] Calling method '.version_select at 0x7fd7a1c2e5e0>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:17:44.872114 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d2ec6005-ee2c-4888-b254-5439d35f948d tempest-VolumesGetTestJSON-1718843450 tempest-VolumesGetTestJSON-1718843450-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/22e51e19-dae2-431b-8714-34111ec81ff3" status: 200 len: 353 microversion: 2.1 time: 0.125835 May 23 17:17:44.873970 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 7/9] 10.222.0.46 () {58 vars in 1244 bytes} [Mon May 23 17:17:44 2022] GET /compute/v2.1/os-volumes/22e51e19-dae2-431b-8714-34111ec81ff3 => generated 353 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:17:44.879488 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-71e55a47-7031-4dc8-a960-4ad28e91d8d9 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0429f5d2715a4487a39281edbd941fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd50da000f94eeca1c4f6ab9867d4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:17:44.913510 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-71e55a47-7031-4dc8-a960-4ad28e91d8d9 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] 10.222.0.46 "GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414" status: 200 len: 1215 microversion: 2.1 time: 0.787277 May 23 17:17:44.914362 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 3/10] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:17:44 2022] GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414 => generated 1215 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:17:45.333778 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-14bf290e-ac3c-4cce-bf3f-b666ac761fcf tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] Calling method '.version_select at 0x7fd7a1c1e9d0>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:17:45.455177 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-14bf290e-ac3c-4cce-bf3f-b666ac761fcf tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/723be79d-d12c-4ed6-b296-dc60943132f7" status: 200 len: 346 microversion: 2.1 time: 0.127147 May 23 17:17:45.455742 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 8/11] 10.222.0.46 () {58 vars in 1244 bytes} [Mon May 23 17:17:45 2022] GET /compute/v2.1/os-volumes/723be79d-d12c-4ed6-b296-dc60943132f7 => generated 346 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:17:45.471674 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e7738f74-7c42-434d-89c3-f22da580b62f tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] Action: 'create', calling method: .version_select at 0x7fd7a0ae7f70>, body: {"snapshot": {"volume_id": "723be79d-d12c-4ed6-b296-dc60943132f7", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-333966759"}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:17:45.896637 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7e5c9d16-aa44-4e25-9c34-478d602069b3 tempest-VolumesGetTestJSON-1718843450 tempest-VolumesGetTestJSON-1718843450-project] Calling method '.version_select at 0x7fd7a1c1ee50>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:17:45.934288 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-e7738f74-7c42-434d-89c3-f22da580b62f tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] 10.222.0.46 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.468674 May 23 17:17:45.936492 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 4/12] 10.222.0.46 () {60 vars in 1161 bytes} [Mon May 23 17:17:45 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:17:45.954323 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2b22bde7-7d38-4901-ac62-d64a4f2de94f tempest-VolumesTestJSON-582931929 tempest-VolumesTestJSON-582931929-project] Calling method '.version_select at 0x7fd7a0aee4c0>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:17:45.979102 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-7e5c9d16-aa44-4e25-9c34-478d602069b3 tempest-VolumesGetTestJSON-1718843450 tempest-VolumesGetTestJSON-1718843450-project] HTTP exception thrown: Volume 22e51e19-dae2-431b-8714-34111ec81ff3 could not be found. May 23 17:17:45.984308 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7e5c9d16-aa44-4e25-9c34-478d602069b3 tempest-VolumesGetTestJSON-1718843450 tempest-VolumesGetTestJSON-1718843450-project] Request method failure captured: May 23 17:17:45.984308 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: request: GET /compute/v2.1/os-volumes/22e51e19-dae2-431b-8714-34111ec81ff3 HTTP/1.1 May 23 17:17:45.984308 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept: application/json May 23 17:17:45.984308 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity May 23 17:17:45.984308 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Connection: close May 23 17:17:45.984308 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Length: 0 May 23 17:17:45.984308 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Type: application/json May 23 17:17:45.984308 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Host: 10.222.0.46 May 23 17:17:45.984308 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None May 23 17:17:45.984308 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.9 May 23 17:17:45.984308 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABii8G0EfpNmjtEncTU-i179l8n1QzcKniACLUyAX5XTdssKMiqeZeJIFU2KTNT3N-PZEP9vtIej0uw0b8sG-DEzUlXgVfCcMEgs94T_Sm4UNVCTgekRzNcTCSj2QiJFmz69nNxc67T73_TGx5DdYiE6smHLTbz9muE-cGInc0QPprSOsQ May 23 17:17:45.984308 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Id: None May 23 17:17:45.984308 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Name: None May 23 17:17:45.984308 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed May 23 17:17:45.984308 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True May 23 17:17:45.984308 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default May 23 17:17:45.984308 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default May 23 17:17:45.984308 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Id: a865909a55e644e98eac9ee2624406b4 May 23 17:17:45.984308 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-VolumesGetTestJSON-1718843450 May 23 17:17:45.984308 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Role: reader,member May 23 17:17:45.984308 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Roles: reader,member May 23 17:17:45.985683 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a865909a55e644e98eac9ee2624406b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a865909a55e644e98eac9ee2624406b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a865909a55e644e98eac9ee2624406b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a865909a55e644e98eac9ee2624406b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:17:45.985683 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-VolumesGetTestJSON-1718843450 May 23 17:17:45.985683 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Id: a865909a55e644e98eac9ee2624406b4 May 23 17:17:45.985683 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-VolumesGetTestJSON-1718843450 May 23 17:17:45.985683 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User: tempest-VolumesGetTestJSON-1718843450-project May 23 17:17:45.985683 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default May 23 17:17:45.985683 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default May 23 17:17:45.985683 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Id: 0beff8a7252549eda71ed73bf5c884c3 May 23 17:17:45.985683 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-VolumesGetTestJSON-1718843450-project May 23 17:17:45.985683 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: method: May 23 17:17:45.985683 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: exception: Volume 22e51e19-dae2-431b-8714-34111ec81ff3 could not be found. May 23 17:17:45.985683 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: action_args: {'id': '22e51e19-dae2-431b-8714-34111ec81ff3'} May 23 17:17:45.985683 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:17:45.986461 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:17:45.986461 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 17:17:45.986461 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 17:17:45.986461 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 17:17:45.986461 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 17:17:45.986461 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 17:17:45.986461 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 17:17:45.986461 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 17:17:45.986461 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 17:17:45.986461 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 17:17:45.986461 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 17:17:45.986461 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 17:17:45.986461 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 17:17:45.986461 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 17:17:45.986461 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 17:17:45.986461 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 22e51e19-dae2-431b-8714-34111ec81ff3 could not be found. (HTTP 404) (Request-ID: req-6003bee3-1ab4-4d9f-9078-34c4ec1e8e1b) May 23 17:17:45.986461 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:17:45.986461 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:17:45.986461 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:17:45.987556 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:17:45.987556 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 23 17:17:45.987556 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 23 17:17:45.987556 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 17:17:45.987556 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 17:17:45.987556 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 17:17:45.987556 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 17:17:45.987556 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 17:17:45.987556 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 17:17:45.987556 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 17:17:45.987556 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 17:17:45.987556 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 17:17:45.987556 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 17:17:45.987556 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 17:17:45.987556 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 17:17:45.987556 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 17:17:45.987556 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 17:17:45.987556 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 17:17:45.987556 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 17:17:45.988582 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 17:17:45.988582 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 17:17:45.988582 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 17:17:45.988582 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 17:17:45.988582 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 22e51e19-dae2-431b-8714-34111ec81ff3 could not be found. May 23 17:17:45.988582 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:17:45.988582 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:17:45.988582 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:17:45.988582 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:17:45.988582 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:17:45.988582 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:17:45.988582 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:17:45.988582 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:17:45.988582 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 17:17:45.988582 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 17:17:45.988582 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:17:45.988582 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:17:45.988582 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 23 17:17:45.988582 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:17:45.989631 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 22e51e19-dae2-431b-8714-34111ec81ff3 could not be found. May 23 17:17:45.989631 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:17:45.989631 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:17:45.989631 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:17:45.989631 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:17:45.989631 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:17:45.989631 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:17:45.989631 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:17:45.989631 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:17:45.989631 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 22e51e19-dae2-431b-8714-34111ec81ff3 could not be found. May 23 17:17:45.989631 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:17:45.989631 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7e5c9d16-aa44-4e25-9c34-478d602069b3 tempest-VolumesGetTestJSON-1718843450 tempest-VolumesGetTestJSON-1718843450-project] Returning 404 to user: Volume 22e51e19-dae2-431b-8714-34111ec81ff3 could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:17:45.989631 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7e5c9d16-aa44-4e25-9c34-478d602069b3 tempest-VolumesGetTestJSON-1718843450 tempest-VolumesGetTestJSON-1718843450-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/22e51e19-dae2-431b-8714-34111ec81ff3" status: 404 len: 109 microversion: 2.1 time: 0.104877 May 23 17:17:45.991520 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 9/13] 10.222.0.46 () {58 vars in 1244 bytes} [Mon May 23 17:17:45 2022] GET /compute/v2.1/os-volumes/22e51e19-dae2-431b-8714-34111ec81ff3 => generated 109 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:17:46.008005 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4ca88e8f-07df-4a11-8d09-63d0dcc6ef0c tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:17:46.008910 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4ca88e8f-07df-4a11-8d09-63d0dcc6ef0c tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] [instance: 531aeff0-e028-4f24-9d36-a48492b18414] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:17:46.082421 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2b22bde7-7d38-4901-ac62-d64a4f2de94f tempest-VolumesTestJSON-582931929 tempest-VolumesTestJSON-582931929-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/1addc94b-cf67-44c6-8de1-f06b7c449036" status: 200 len: 351 microversion: 2.1 time: 0.137735 May 23 17:17:46.095907 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 5/14] 10.222.0.46 () {58 vars in 1244 bytes} [Mon May 23 17:17:45 2022] GET /compute/v2.1/os-volumes/1addc94b-cf67-44c6-8de1-f06b7c449036 => generated 351 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:17:46.107316 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-1df6dd33-25d7-4cd9-b69f-5ce609a9bd47 tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] Calling method '.version_select at 0x7fd7a0aeec10>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:17:46.181420 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-1df6dd33-25d7-4cd9-b69f-5ce609a9bd47 tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/356612dc-2a32-4845-9465-1b00429ed3ac" status: 200 len: 286 microversion: 2.1 time: 0.084083 May 23 17:17:46.182012 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 6/15] 10.222.0.46 () {58 vars in 1250 bytes} [Mon May 23 17:17:46 2022] GET /compute/v2.1/os-snapshots/356612dc-2a32-4845-9465-1b00429ed3ac => generated 286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:17:46.219824 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-4747dda7-14c8-4b36-a01c-8930688d927a tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] Calling method '.version_select at 0x7fd7a0aee820>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:17:46.258362 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4ca88e8f-07df-4a11-8d09-63d0dcc6ef0c tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0429f5d2715a4487a39281edbd941fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd50da000f94eeca1c4f6ab9867d4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:17:46.303103 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4ca88e8f-07df-4a11-8d09-63d0dcc6ef0c tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] 10.222.0.46 "GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414" status: 200 len: 1215 microversion: 2.1 time: 0.311330 May 23 17:17:46.307708 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 10/16] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:17:45 2022] GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414 => generated 1215 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:17:46.327475 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-4747dda7-14c8-4b36-a01c-8930688d927a tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.123980 May 23 17:17:46.330822 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 7/17] 10.222.0.46 () {58 vars in 1139 bytes} [Mon May 23 17:17:46 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:17:46.340927 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d7c2fc83-3c6c-41e7-8f2e-85dddcba358f tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] Calling method '.version_select at 0x7fd7a1c0b790>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:17:46.423773 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d7c2fc83-3c6c-41e7-8f2e-85dddcba358f tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/356612dc-2a32-4845-9465-1b00429ed3ac" status: 200 len: 286 microversion: 2.1 time: 0.087226 May 23 17:17:46.426573 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 11/18] 10.222.0.46 () {58 vars in 1250 bytes} [Mon May 23 17:17:46 2022] GET /compute/v2.1/os-snapshots/356612dc-2a32-4845-9465-1b00429ed3ac => generated 286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 17:17:47.324400 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d3705e32-6e34-4a9c-86c4-5d5336ada1f9 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:17:47.325765 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d3705e32-6e34-4a9c-86c4-5d5336ada1f9 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] [instance: 531aeff0-e028-4f24-9d36-a48492b18414] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:17:47.341657 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d3705e32-6e34-4a9c-86c4-5d5336ada1f9 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:17:47.342308 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d3705e32-6e34-4a9c-86c4-5d5336ada1f9 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:17:47.346773 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d3705e32-6e34-4a9c-86c4-5d5336ada1f9 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:17:47.348477 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d3705e32-6e34-4a9c-86c4-5d5336ada1f9 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:17:47.440183 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b2846b23-3278-439c-ad19-90392ad7279e tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] Calling method '.version_select at 0x7fd7a1c0b5e0>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:17:47.625346 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b2846b23-3278-439c-ad19-90392ad7279e tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/356612dc-2a32-4845-9465-1b00429ed3ac" status: 200 len: 286 microversion: 2.1 time: 0.189059 May 23 17:17:47.626502 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 12/19] 10.222.0.46 () {58 vars in 1250 bytes} [Mon May 23 17:17:47 2022] GET /compute/v2.1/os-snapshots/356612dc-2a32-4845-9465-1b00429ed3ac => generated 286 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 17:17:47.680071 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d3705e32-6e34-4a9c-86c4-5d5336ada1f9 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0429f5d2715a4487a39281edbd941fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd50da000f94eeca1c4f6ab9867d4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:17:47.709707 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d3705e32-6e34-4a9c-86c4-5d5336ada1f9 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] 10.222.0.46 "GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414" status: 200 len: 1219 microversion: 2.1 time: 0.388315 May 23 17:17:47.713735 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 8/20] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:17:47 2022] GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414 => generated 1219 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:17:48.639513 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1346a7ee-2377-47e3-b58b-a4315dc94a23 tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] Calling method '.version_select at 0x7fd7a1b58940>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:17:48.699151 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1346a7ee-2377-47e3-b58b-a4315dc94a23 tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/356612dc-2a32-4845-9465-1b00429ed3ac" status: 200 len: 286 microversion: 2.1 time: 0.065461 May 23 17:17:48.702899 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 13/21] 10.222.0.46 () {58 vars in 1250 bytes} [Mon May 23 17:17:48 2022] GET /compute/v2.1/os-snapshots/356612dc-2a32-4845-9465-1b00429ed3ac => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:17:48.732621 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d49aca3b-2bc3-4cc2-83fa-1fde5ff5c444 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:17:48.733927 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d49aca3b-2bc3-4cc2-83fa-1fde5ff5c444 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] [instance: 531aeff0-e028-4f24-9d36-a48492b18414] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:17:48.747218 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d49aca3b-2bc3-4cc2-83fa-1fde5ff5c444 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:17:48.748179 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d49aca3b-2bc3-4cc2-83fa-1fde5ff5c444 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:17:48.750057 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d49aca3b-2bc3-4cc2-83fa-1fde5ff5c444 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:17:48.752795 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d49aca3b-2bc3-4cc2-83fa-1fde5ff5c444 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:17:48.866639 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d49aca3b-2bc3-4cc2-83fa-1fde5ff5c444 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0429f5d2715a4487a39281edbd941fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd50da000f94eeca1c4f6ab9867d4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:17:48.879042 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d49aca3b-2bc3-4cc2-83fa-1fde5ff5c444 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] 10.222.0.46 "GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414" status: 200 len: 1219 microversion: 2.1 time: 0.149855 May 23 17:17:48.880199 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 9/22] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:17:48 2022] GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414 => generated 1219 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:17:49.714997 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5e677a2d-5056-4f06-bcb7-572f49b4db9c tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] Calling method '.version_select at 0x7fd7a1b64040>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:17:49.803914 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5e677a2d-5056-4f06-bcb7-572f49b4db9c tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/356612dc-2a32-4845-9465-1b00429ed3ac" status: 200 len: 287 microversion: 2.1 time: 0.092782 May 23 17:17:49.804686 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 14/23] 10.222.0.46 () {58 vars in 1250 bytes} [Mon May 23 17:17:49 2022] GET /compute/v2.1/os-snapshots/356612dc-2a32-4845-9465-1b00429ed3ac => generated 287 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:17:49.815637 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e674dd9d-b7e7-40a6-801e-15ffd11c4ed7 tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] Calling method '.version_select at 0x7fd7a0a8a310>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:17:49.902011 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a7677a54-fc8b-464d-a735-e7458211c6d8 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:17:49.902487 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a7677a54-fc8b-464d-a735-e7458211c6d8 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] [instance: 531aeff0-e028-4f24-9d36-a48492b18414] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:17:49.921107 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a7677a54-fc8b-464d-a735-e7458211c6d8 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:17:49.923040 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a7677a54-fc8b-464d-a735-e7458211c6d8 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:17:49.923915 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a7677a54-fc8b-464d-a735-e7458211c6d8 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:17:49.924366 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a7677a54-fc8b-464d-a735-e7458211c6d8 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:17:49.985507 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-e674dd9d-b7e7-40a6-801e-15ffd11c4ed7 tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] 10.222.0.46 "DELETE /compute/v2.1/os-snapshots/356612dc-2a32-4845-9465-1b00429ed3ac" status: 202 len: 0 microversion: 2.1 time: 0.174401 May 23 17:17:49.987154 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 10/24] 10.222.0.46 () {58 vars in 1253 bytes} [Mon May 23 17:17:49 2022] DELETE /compute/v2.1/os-snapshots/356612dc-2a32-4845-9465-1b00429ed3ac => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 17:17:50.006884 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-5a4d68b9-76af-4316-b503-0bfb680ae406 tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] Calling method '.version_select at 0x7fd7a0a165e0>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:17:50.103577 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-5a4d68b9-76af-4316-b503-0bfb680ae406 tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/356612dc-2a32-4845-9465-1b00429ed3ac" status: 200 len: 286 microversion: 2.1 time: 0.104299 May 23 17:17:50.107716 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 11/25] 10.222.0.46 () {58 vars in 1250 bytes} [Mon May 23 17:17:49 2022] GET /compute/v2.1/os-snapshots/356612dc-2a32-4845-9465-1b00429ed3ac => generated 286 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:17:50.307231 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-99a64671-8b6e-4ca9-9cec-6795ed2f9c9b tempest-VolumesTestJSON-582931929 tempest-VolumesTestJSON-582931929-project] Calling method '.version_select at 0x7fd7a0a73b80>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:17:50.508380 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-99a64671-8b6e-4ca9-9cec-6795ed2f9c9b tempest-VolumesTestJSON-582931929 tempest-VolumesTestJSON-582931929-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/fdacf723-b0e0-4a34-915a-8eb821f53927" status: 200 len: 351 microversion: 2.1 time: 0.205423 May 23 17:17:50.509021 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 12/26] 10.222.0.46 () {58 vars in 1244 bytes} [Mon May 23 17:17:50 2022] GET /compute/v2.1/os-volumes/fdacf723-b0e0-4a34-915a-8eb821f53927 => generated 351 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 17:17:50.522223 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a2981f47-aa8f-4304-9596-c4cfebdb88aa tempest-VolumesTestJSON-582931929 tempest-VolumesTestJSON-582931929-project] Calling method '.version_select at 0x7fd7a0a8a1f0>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:17:50.730924 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-a2981f47-aa8f-4304-9596-c4cfebdb88aa tempest-VolumesTestJSON-582931929 tempest-VolumesTestJSON-582931929-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.213003 May 23 17:17:50.731687 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 13/27] 10.222.0.46 () {58 vars in 1133 bytes} [Mon May 23 17:17:50 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:17:50.745461 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c58fd6b9-8fdd-48d5-b295-7dc3ce3f7799 tempest-VolumesTestJSON-582931929 tempest-VolumesTestJSON-582931929-project] Calling method '.version_select at 0x7fd7a0aee8b0>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:17:50.754137 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a7677a54-fc8b-464d-a735-e7458211c6d8 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0429f5d2715a4487a39281edbd941fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd50da000f94eeca1c4f6ab9867d4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:17:50.834145 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a7677a54-fc8b-464d-a735-e7458211c6d8 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] 10.222.0.46 "GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414" status: 200 len: 1267 microversion: 2.1 time: 0.936744 May 23 17:17:50.835001 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 15/28] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:17:49 2022] GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414 => generated 1267 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:17:51.027803 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c58fd6b9-8fdd-48d5-b295-7dc3ce3f7799 tempest-VolumesTestJSON-582931929 tempest-VolumesTestJSON-582931929-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.287233 May 23 17:17:51.028706 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 14/29] 10.222.0.46 () {58 vars in 1148 bytes} [Mon May 23 17:17:50 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:17:51.043823 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-934496fa-3909-4d68-9a26-67f57aa2b770 tempest-VolumesTestJSON-582931929 tempest-VolumesTestJSON-582931929-project] Calling method '.version_select at 0x7fd7a1b11af0>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:17:51.116824 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-88106af0-c9c0-42b2-8e12-fb186bddbeb7 tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] Calling method '.version_select at 0x7fd7a0a27280>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:17:51.243585 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-934496fa-3909-4d68-9a26-67f57aa2b770 tempest-VolumesTestJSON-582931929 tempest-VolumesTestJSON-582931929-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.202092 May 23 17:17:51.252165 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 16/30] 10.222.0.46 () {58 vars in 1133 bytes} [Mon May 23 17:17:51 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:17:51.266013 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-fc6ad235-0296-4e52-bd2b-f907e5722ad7 tempest-VolumesTestJSON-582931929 tempest-VolumesTestJSON-582931929-project] Calling method '.version_select at 0x7fd7a1a9daf0>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:17:51.313899 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-88106af0-c9c0-42b2-8e12-fb186bddbeb7 tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] HTTP exception thrown: Snapshot 356612dc-2a32-4845-9465-1b00429ed3ac could not be found. May 23 17:17:51.318557 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-88106af0-c9c0-42b2-8e12-fb186bddbeb7 tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] Request method failure captured: May 23 17:17:51.318557 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: request: GET /compute/v2.1/os-snapshots/356612dc-2a32-4845-9465-1b00429ed3ac HTTP/1.1 May 23 17:17:51.318557 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept: application/json May 23 17:17:51.318557 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity May 23 17:17:51.318557 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Connection: close May 23 17:17:51.318557 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Length: 0 May 23 17:17:51.318557 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Type: application/json May 23 17:17:51.318557 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Host: 10.222.0.46 May 23 17:17:51.318557 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None May 23 17:17:51.318557 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.9 May 23 17:17:51.318557 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABii8G1U4VBvbUcl5ey781vNCdCB6EkS9Dt_XdGqnsryk5L_2fyfO2GO49ZPLqjaAIAmSl5t0V9tYyhhcl4PEDmwOO5eTV1K3L2dDUF1eSk9TGJHEfbd__Z-iJL9YWl-x1tXEA2Xyf6fyx0WldDUMEm5TGZdUEzn4_0fEVraXVtbjQpfPc May 23 17:17:51.318557 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Id: None May 23 17:17:51.318557 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Name: None May 23 17:17:51.318557 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed May 23 17:17:51.318557 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True May 23 17:17:51.318557 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default May 23 17:17:51.318557 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default May 23 17:17:51.318557 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Id: becff460f58c4be7adfb2052bdf128be May 23 17:17:51.318557 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-848672019 May 23 17:17:51.318557 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Role: reader,member May 23 17:17:51.318557 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Roles: reader,member May 23 17:17:51.319666 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/becff460f58c4be7adfb2052bdf128be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/becff460f58c4be7adfb2052bdf128be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/becff460f58c4be7adfb2052bdf128be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_becff460f58c4be7adfb2052bdf128be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:17:51.319666 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-VolumesSnapshotsTestJSON-848672019 May 23 17:17:51.319666 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Id: becff460f58c4be7adfb2052bdf128be May 23 17:17:51.319666 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-848672019 May 23 17:17:51.319666 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User: tempest-VolumesSnapshotsTestJSON-848672019-project May 23 17:17:51.319666 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default May 23 17:17:51.319666 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default May 23 17:17:51.319666 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Id: 3e168fb970b64e0e9298cebc2650049a May 23 17:17:51.319666 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-VolumesSnapshotsTestJSON-848672019-project May 23 17:17:51.319666 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: method: May 23 17:17:51.319666 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: exception: Snapshot 356612dc-2a32-4845-9465-1b00429ed3ac could not be found. May 23 17:17:51.319666 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: action_args: {'id': '356612dc-2a32-4845-9465-1b00429ed3ac'} May 23 17:17:51.319666 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:17:51.320311 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:17:51.320311 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 23 17:17:51.320311 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 23 17:17:51.320311 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 23 17:17:51.320311 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 23 17:17:51.320311 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 23 17:17:51.320311 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 23 17:17:51.320311 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 17:17:51.320311 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 17:17:51.320311 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 17:17:51.320311 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 17:17:51.320311 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 17:17:51.320311 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 17:17:51.320311 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 17:17:51.320311 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 17:17:51.320311 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 356612dc-2a32-4845-9465-1b00429ed3ac could not be found. (HTTP 404) (Request-ID: req-6ef7aabd-07c9-4071-9a76-c5023cc491f2) May 23 17:17:51.320311 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:17:51.320311 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:17:51.321186 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:17:51.321186 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:17:51.321186 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 23 17:17:51.321186 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 23 17:17:51.321186 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 17:17:51.321186 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 17:17:51.321186 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 23 17:17:51.321186 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 23 17:17:51.321186 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 17:17:51.321186 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 17:17:51.321186 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 23 17:17:51.321186 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 23 17:17:51.321186 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 23 17:17:51.321186 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 23 17:17:51.321186 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 23 17:17:51.321186 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 23 17:17:51.321186 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 17:17:51.321186 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 17:17:51.321186 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 17:17:51.322814 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 17:17:51.322814 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 17:17:51.322814 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 17:17:51.322814 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 17:17:51.322814 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 17:17:51.322814 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 356612dc-2a32-4845-9465-1b00429ed3ac could not be found. May 23 17:17:51.322814 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:17:51.322814 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:17:51.322814 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:17:51.322814 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:17:51.322814 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:17:51.322814 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:17:51.322814 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:17:51.322814 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:17:51.322814 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 17:17:51.322814 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 17:17:51.322814 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:17:51.322814 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:17:51.322814 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 23 17:17:51.322814 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:17:51.323948 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 356612dc-2a32-4845-9465-1b00429ed3ac could not be found. May 23 17:17:51.323948 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:17:51.323948 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:17:51.323948 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:17:51.323948 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:17:51.323948 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:17:51.323948 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:17:51.323948 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:17:51.323948 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:17:51.323948 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 356612dc-2a32-4845-9465-1b00429ed3ac could not be found. May 23 17:17:51.323948 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:17:51.325522 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-88106af0-c9c0-42b2-8e12-fb186bddbeb7 tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] Returning 404 to user: Snapshot 356612dc-2a32-4845-9465-1b00429ed3ac could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:17:51.326773 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-88106af0-c9c0-42b2-8e12-fb186bddbeb7 tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/356612dc-2a32-4845-9465-1b00429ed3ac" status: 404 len: 111 microversion: 2.1 time: 0.215255 May 23 17:17:51.327745 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 15/31] 10.222.0.46 () {58 vars in 1250 bytes} [Mon May 23 17:17:51 2022] GET /compute/v2.1/os-snapshots/356612dc-2a32-4845-9465-1b00429ed3ac => generated 111 bytes in 217 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:17:51.345795 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-10251e60-0b54-4e48-bef8-6e04b10bb3e4 tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] Calling method '.version_select at 0x7fd7a0a275e0>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:17:51.460912 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-fc6ad235-0296-4e52-bd2b-f907e5722ad7 tempest-VolumesTestJSON-582931929 tempest-VolumesTestJSON-582931929-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.201110 May 23 17:17:51.461504 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 17/32] 10.222.0.46 () {58 vars in 1166 bytes} [Mon May 23 17:17:51 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 17:17:51.477856 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-779d1c3d-d70e-44a4-b089-8235811d9461 tempest-VolumesTestJSON-582931929 tempest-VolumesTestJSON-582931929-project] Calling method '.version_select at 0x7fd7a1a9d8b0>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:17:51.556296 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-10251e60-0b54-4e48-bef8-6e04b10bb3e4 tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/723be79d-d12c-4ed6-b296-dc60943132f7" status: 202 len: 0 microversion: 2.1 time: 0.224247 May 23 17:17:51.557077 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 16/33] 10.222.0.46 () {58 vars in 1247 bytes} [Mon May 23 17:17:51 2022] DELETE /compute/v2.1/os-volumes/723be79d-d12c-4ed6-b296-dc60943132f7 => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 17:17:51.567134 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a851c395-e37e-4186-b2f9-f1bf4f63215a tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] Calling method '.version_select at 0x7fd7a0a27af0>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:17:51.642233 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-779d1c3d-d70e-44a4-b089-8235811d9461 tempest-VolumesTestJSON-582931929 tempest-VolumesTestJSON-582931929-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.170738 May 23 17:17:51.643782 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 18/34] 10.222.0.46 () {58 vars in 1169 bytes} [Mon May 23 17:17:51 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:17:51.657797 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-050f9ec8-607b-4bea-ac3a-27bc72e1748c tempest-VolumesTestJSON-582931929 tempest-VolumesTestJSON-582931929-project] Calling method '.version_select at 0x7fd7a1bbd0d0>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:17:51.678220 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-a851c395-e37e-4186-b2f9-f1bf4f63215a tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/723be79d-d12c-4ed6-b296-dc60943132f7" status: 200 len: 345 microversion: 2.1 time: 0.115609 May 23 17:17:51.679184 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 17/35] 10.222.0.46 () {58 vars in 1244 bytes} [Mon May 23 17:17:51 2022] GET /compute/v2.1/os-volumes/723be79d-d12c-4ed6-b296-dc60943132f7 => generated 345 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 17:17:51.820903 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-050f9ec8-607b-4bea-ac3a-27bc72e1748c tempest-VolumesTestJSON-582931929 tempest-VolumesTestJSON-582931929-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.169204 May 23 17:17:51.821562 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 19/36] 10.222.0.46 () {58 vars in 1154 bytes} [Mon May 23 17:17:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:17:51.833475 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e53492a4-735d-4625-a8cf-cc2a75685e17 tempest-VolumesTestJSON-582931929 tempest-VolumesTestJSON-582931929-project] Calling method '.version_select at 0x7fd7a0a165e0>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:17:51.852426 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-66cc65a6-d56c-46cf-a095-5636afd83a18 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:17:51.853400 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-66cc65a6-d56c-46cf-a095-5636afd83a18 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] [instance: 531aeff0-e028-4f24-9d36-a48492b18414] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:17:51.866187 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-66cc65a6-d56c-46cf-a095-5636afd83a18 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:17:51.884009 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-66cc65a6-d56c-46cf-a095-5636afd83a18 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:17:51.885371 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-66cc65a6-d56c-46cf-a095-5636afd83a18 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:17:51.888278 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-66cc65a6-d56c-46cf-a095-5636afd83a18 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:17:52.071417 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-e53492a4-735d-4625-a8cf-cc2a75685e17 tempest-VolumesTestJSON-582931929 tempest-VolumesTestJSON-582931929-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.242026 May 23 17:17:52.073027 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 18/37] 10.222.0.46 () {58 vars in 1187 bytes} [Mon May 23 17:17:51 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:17:52.086581 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c7bda8b7-39aa-4a8e-a767-c5e5518d443d tempest-VolumesTestJSON-582931929 tempest-VolumesTestJSON-582931929-project] Calling method '.version_select at 0x7fd7a0a273a0>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:17:52.219228 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c7bda8b7-39aa-4a8e-a767-c5e5518d443d tempest-VolumesTestJSON-582931929 tempest-VolumesTestJSON-582931929-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.138641 May 23 17:17:52.220462 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 19/38] 10.222.0.46 () {58 vars in 1154 bytes} [Mon May 23 17:17:52 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:17:52.348493 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-66cc65a6-d56c-46cf-a095-5636afd83a18 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0429f5d2715a4487a39281edbd941fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd50da000f94eeca1c4f6ab9867d4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:17:52.377252 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-66cc65a6-d56c-46cf-a095-5636afd83a18 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] 10.222.0.46 "GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414" status: 200 len: 1273 microversion: 2.1 time: 0.529482 May 23 17:17:52.391241 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 20/39] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:17:51 2022] GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414 => generated 1273 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:17:52.699076 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-5b07f688-c100-449d-877b-c6943d6b9a71 tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] Calling method '.version_select at 0x7fd7a0a39e50>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:17:52.761957 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-5b07f688-c100-449d-877b-c6943d6b9a71 tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] HTTP exception thrown: Volume 723be79d-d12c-4ed6-b296-dc60943132f7 could not be found. May 23 17:17:52.765453 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-5b07f688-c100-449d-877b-c6943d6b9a71 tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] Request method failure captured: May 23 17:17:52.765453 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: request: GET /compute/v2.1/os-volumes/723be79d-d12c-4ed6-b296-dc60943132f7 HTTP/1.1 May 23 17:17:52.765453 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept: application/json May 23 17:17:52.765453 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity May 23 17:17:52.765453 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Connection: close May 23 17:17:52.765453 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Length: 0 May 23 17:17:52.765453 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Type: application/json May 23 17:17:52.765453 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Host: 10.222.0.46 May 23 17:17:52.765453 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None May 23 17:17:52.765453 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.9 May 23 17:17:52.765453 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABii8G1U4VBvbUcl5ey781vNCdCB6EkS9Dt_XdGqnsryk5L_2fyfO2GO49ZPLqjaAIAmSl5t0V9tYyhhcl4PEDmwOO5eTV1K3L2dDUF1eSk9TGJHEfbd__Z-iJL9YWl-x1tXEA2Xyf6fyx0WldDUMEm5TGZdUEzn4_0fEVraXVtbjQpfPc May 23 17:17:52.765453 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Id: None May 23 17:17:52.765453 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Name: None May 23 17:17:52.765453 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed May 23 17:17:52.765453 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True May 23 17:17:52.765453 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default May 23 17:17:52.765453 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default May 23 17:17:52.765453 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Id: becff460f58c4be7adfb2052bdf128be May 23 17:17:52.765453 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-848672019 May 23 17:17:52.765453 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Role: reader,member May 23 17:17:52.765453 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Roles: reader,member May 23 17:17:52.766661 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/becff460f58c4be7adfb2052bdf128be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/becff460f58c4be7adfb2052bdf128be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/becff460f58c4be7adfb2052bdf128be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_becff460f58c4be7adfb2052bdf128be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:17:52.766661 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-VolumesSnapshotsTestJSON-848672019 May 23 17:17:52.766661 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Id: becff460f58c4be7adfb2052bdf128be May 23 17:17:52.766661 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-848672019 May 23 17:17:52.766661 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User: tempest-VolumesSnapshotsTestJSON-848672019-project May 23 17:17:52.766661 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default May 23 17:17:52.766661 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default May 23 17:17:52.766661 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Id: 3e168fb970b64e0e9298cebc2650049a May 23 17:17:52.766661 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-VolumesSnapshotsTestJSON-848672019-project May 23 17:17:52.766661 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: method: May 23 17:17:52.766661 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: exception: Volume 723be79d-d12c-4ed6-b296-dc60943132f7 could not be found. May 23 17:17:52.766661 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: action_args: {'id': '723be79d-d12c-4ed6-b296-dc60943132f7'} May 23 17:17:52.766661 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:17:52.767338 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:17:52.767338 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 17:17:52.767338 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 17:17:52.767338 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 17:17:52.767338 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 17:17:52.767338 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 17:17:52.767338 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 17:17:52.767338 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 17:17:52.767338 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 17:17:52.767338 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 17:17:52.767338 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 17:17:52.767338 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 17:17:52.767338 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 17:17:52.767338 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 17:17:52.767338 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 17:17:52.767338 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 723be79d-d12c-4ed6-b296-dc60943132f7 could not be found. (HTTP 404) (Request-ID: req-95a238a3-a532-4efc-b42d-df3bd53b73a1) May 23 17:17:52.767338 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:17:52.767338 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:17:52.767338 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:17:52.768203 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:17:52.768203 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 23 17:17:52.768203 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 23 17:17:52.768203 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 17:17:52.768203 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 17:17:52.768203 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 17:17:52.768203 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 17:17:52.768203 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 17:17:52.768203 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 17:17:52.768203 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 17:17:52.768203 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 17:17:52.768203 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 17:17:52.768203 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 17:17:52.768203 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 17:17:52.768203 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 17:17:52.768203 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 17:17:52.768203 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 17:17:52.768203 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 17:17:52.768203 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 17:17:52.769121 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 17:17:52.769121 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 17:17:52.769121 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 17:17:52.769121 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 17:17:52.769121 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 723be79d-d12c-4ed6-b296-dc60943132f7 could not be found. May 23 17:17:52.769121 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:17:52.769121 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:17:52.769121 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:17:52.769121 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:17:52.769121 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:17:52.769121 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:17:52.769121 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:17:52.769121 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:17:52.769121 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 17:17:52.769121 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 17:17:52.769121 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:17:52.769121 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:17:52.769121 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 23 17:17:52.769121 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:17:52.770106 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 723be79d-d12c-4ed6-b296-dc60943132f7 could not be found. May 23 17:17:52.770106 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:17:52.770106 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:17:52.770106 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:17:52.770106 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:17:52.770106 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:17:52.770106 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:17:52.770106 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:17:52.770106 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:17:52.770106 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 723be79d-d12c-4ed6-b296-dc60943132f7 could not be found. May 23 17:17:52.770106 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:17:52.770106 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-5b07f688-c100-449d-877b-c6943d6b9a71 tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] Returning 404 to user: Volume 723be79d-d12c-4ed6-b296-dc60943132f7 could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:17:52.770106 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-5b07f688-c100-449d-877b-c6943d6b9a71 tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/723be79d-d12c-4ed6-b296-dc60943132f7" status: 404 len: 109 microversion: 2.1 time: 0.077118 May 23 17:17:52.770106 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 20/40] 10.222.0.46 () {58 vars in 1244 bytes} [Mon May 23 17:17:52 2022] GET /compute/v2.1/os-volumes/723be79d-d12c-4ed6-b296-dc60943132f7 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:17:52.779372 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6bbb09fb-261e-47c0-864c-917315a3d4be tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] Calling method '.version_select at 0x7fd7a1a9d5e0>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:17:52.869701 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-6bbb09fb-261e-47c0-864c-917315a3d4be tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] HTTP exception thrown: Volume 723be79d-d12c-4ed6-b296-dc60943132f7 could not be found. May 23 17:17:52.871761 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6bbb09fb-261e-47c0-864c-917315a3d4be tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] Request method failure captured: May 23 17:17:52.871761 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: request: DELETE /compute/v2.1/os-volumes/723be79d-d12c-4ed6-b296-dc60943132f7 HTTP/1.1 May 23 17:17:52.871761 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept: application/json May 23 17:17:52.871761 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity May 23 17:17:52.871761 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Connection: close May 23 17:17:52.871761 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Length: 0 May 23 17:17:52.871761 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Type: application/json May 23 17:17:52.871761 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Host: 10.222.0.46 May 23 17:17:52.871761 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None May 23 17:17:52.871761 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.9 May 23 17:17:52.871761 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABii8G1U4VBvbUcl5ey781vNCdCB6EkS9Dt_XdGqnsryk5L_2fyfO2GO49ZPLqjaAIAmSl5t0V9tYyhhcl4PEDmwOO5eTV1K3L2dDUF1eSk9TGJHEfbd__Z-iJL9YWl-x1tXEA2Xyf6fyx0WldDUMEm5TGZdUEzn4_0fEVraXVtbjQpfPc May 23 17:17:52.871761 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Id: None May 23 17:17:52.871761 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Name: None May 23 17:17:52.871761 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed May 23 17:17:52.871761 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True May 23 17:17:52.871761 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default May 23 17:17:52.871761 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default May 23 17:17:52.871761 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Id: becff460f58c4be7adfb2052bdf128be May 23 17:17:52.871761 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-848672019 May 23 17:17:52.871761 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Role: reader,member May 23 17:17:52.871761 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Roles: reader,member May 23 17:17:52.873187 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/becff460f58c4be7adfb2052bdf128be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/becff460f58c4be7adfb2052bdf128be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/becff460f58c4be7adfb2052bdf128be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_becff460f58c4be7adfb2052bdf128be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:17:52.873187 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-VolumesSnapshotsTestJSON-848672019 May 23 17:17:52.873187 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Id: becff460f58c4be7adfb2052bdf128be May 23 17:17:52.873187 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-848672019 May 23 17:17:52.873187 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User: tempest-VolumesSnapshotsTestJSON-848672019-project May 23 17:17:52.873187 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default May 23 17:17:52.873187 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default May 23 17:17:52.873187 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Id: 3e168fb970b64e0e9298cebc2650049a May 23 17:17:52.873187 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-VolumesSnapshotsTestJSON-848672019-project May 23 17:17:52.873187 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: method: May 23 17:17:52.873187 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: exception: Volume 723be79d-d12c-4ed6-b296-dc60943132f7 could not be found. May 23 17:17:52.873187 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: action_args: {'id': '723be79d-d12c-4ed6-b296-dc60943132f7'} May 23 17:17:52.873187 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:17:52.873904 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:17:52.873904 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 17:17:52.873904 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 17:17:52.873904 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 17:17:52.873904 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 17:17:52.873904 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 17:17:52.873904 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 17:17:52.873904 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 17:17:52.873904 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 17:17:52.873904 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 17:17:52.873904 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 17:17:52.873904 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 17:17:52.873904 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 17:17:52.873904 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 17:17:52.873904 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 17:17:52.873904 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 723be79d-d12c-4ed6-b296-dc60943132f7 could not be found. (HTTP 404) (Request-ID: req-df1de5f6-b4b0-495d-8cf4-08f3da31e68e) May 23 17:17:52.873904 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:17:52.873904 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:17:52.873904 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:17:52.874886 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:17:52.874886 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 23 17:17:52.874886 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 23 17:17:52.874886 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 17:17:52.874886 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 17:17:52.874886 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 17:17:52.874886 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 17:17:52.874886 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 17:17:52.874886 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 17:17:52.874886 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 17:17:52.874886 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 17:17:52.874886 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 17:17:52.874886 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 17:17:52.874886 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 17:17:52.874886 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 17:17:52.874886 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 17:17:52.874886 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 17:17:52.874886 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 17:17:52.874886 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 17:17:52.875808 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 17:17:52.875808 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 17:17:52.875808 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 17:17:52.875808 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 17:17:52.875808 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 723be79d-d12c-4ed6-b296-dc60943132f7 could not be found. May 23 17:17:52.875808 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:17:52.875808 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:17:52.875808 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:17:52.875808 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:17:52.875808 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:17:52.875808 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:17:52.875808 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:17:52.875808 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:17:52.875808 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 17:17:52.875808 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 17:17:52.875808 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:17:52.875808 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:17:52.875808 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 23 17:17:52.875808 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:17:52.878810 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 723be79d-d12c-4ed6-b296-dc60943132f7 could not be found. May 23 17:17:52.878810 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:17:52.878810 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:17:52.878810 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:17:52.878810 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:17:52.878810 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:17:52.878810 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:17:52.878810 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:17:52.878810 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:17:52.878810 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 723be79d-d12c-4ed6-b296-dc60943132f7 could not be found. May 23 17:17:52.878810 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:17:52.878810 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6bbb09fb-261e-47c0-864c-917315a3d4be tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] Returning 404 to user: Volume 723be79d-d12c-4ed6-b296-dc60943132f7 could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:17:52.878810 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6bbb09fb-261e-47c0-864c-917315a3d4be tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/723be79d-d12c-4ed6-b296-dc60943132f7" status: 404 len: 109 microversion: 2.1 time: 0.099059 May 23 17:17:52.878810 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 21/41] 10.222.0.46 () {58 vars in 1247 bytes} [Mon May 23 17:17:52 2022] DELETE /compute/v2.1/os-volumes/723be79d-d12c-4ed6-b296-dc60943132f7 => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:17:52.883796 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-3ff2fa0b-ef20-42ec-a2f0-cf5029aa4bb2 tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] Calling method '.version_select at 0x7fd7a0a275e0>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:17:52.939912 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-3ff2fa0b-ef20-42ec-a2f0-cf5029aa4bb2 tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] HTTP exception thrown: Volume 723be79d-d12c-4ed6-b296-dc60943132f7 could not be found. May 23 17:17:52.941563 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-3ff2fa0b-ef20-42ec-a2f0-cf5029aa4bb2 tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] Request method failure captured: May 23 17:17:52.941563 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: request: GET /compute/v2.1/os-volumes/723be79d-d12c-4ed6-b296-dc60943132f7 HTTP/1.1 May 23 17:17:52.941563 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept: application/json May 23 17:17:52.941563 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity May 23 17:17:52.941563 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Connection: close May 23 17:17:52.941563 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Length: 0 May 23 17:17:52.941563 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Type: application/json May 23 17:17:52.941563 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Host: 10.222.0.46 May 23 17:17:52.941563 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None May 23 17:17:52.941563 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.9 May 23 17:17:52.941563 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABii8G1U4VBvbUcl5ey781vNCdCB6EkS9Dt_XdGqnsryk5L_2fyfO2GO49ZPLqjaAIAmSl5t0V9tYyhhcl4PEDmwOO5eTV1K3L2dDUF1eSk9TGJHEfbd__Z-iJL9YWl-x1tXEA2Xyf6fyx0WldDUMEm5TGZdUEzn4_0fEVraXVtbjQpfPc May 23 17:17:52.941563 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Id: None May 23 17:17:52.941563 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Name: None May 23 17:17:52.941563 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed May 23 17:17:52.941563 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True May 23 17:17:52.941563 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default May 23 17:17:52.941563 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default May 23 17:17:52.941563 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Id: becff460f58c4be7adfb2052bdf128be May 23 17:17:52.941563 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-848672019 May 23 17:17:52.941563 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Role: reader,member May 23 17:17:52.941563 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Roles: reader,member May 23 17:17:52.942624 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/becff460f58c4be7adfb2052bdf128be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/becff460f58c4be7adfb2052bdf128be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/becff460f58c4be7adfb2052bdf128be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_becff460f58c4be7adfb2052bdf128be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:17:52.942624 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-VolumesSnapshotsTestJSON-848672019 May 23 17:17:52.942624 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Id: becff460f58c4be7adfb2052bdf128be May 23 17:17:52.942624 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-848672019 May 23 17:17:52.942624 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User: tempest-VolumesSnapshotsTestJSON-848672019-project May 23 17:17:52.942624 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default May 23 17:17:52.942624 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default May 23 17:17:52.942624 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Id: 3e168fb970b64e0e9298cebc2650049a May 23 17:17:52.942624 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-VolumesSnapshotsTestJSON-848672019-project May 23 17:17:52.942624 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: method: May 23 17:17:52.942624 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: exception: Volume 723be79d-d12c-4ed6-b296-dc60943132f7 could not be found. May 23 17:17:52.942624 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: action_args: {'id': '723be79d-d12c-4ed6-b296-dc60943132f7'} May 23 17:17:52.942624 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:17:52.943305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:17:52.943305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 17:17:52.943305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 17:17:52.943305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 17:17:52.943305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 17:17:52.943305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 17:17:52.943305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 17:17:52.943305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 17:17:52.943305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 17:17:52.943305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 17:17:52.943305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 17:17:52.943305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 17:17:52.943305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 17:17:52.943305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 17:17:52.943305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 17:17:52.943305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 723be79d-d12c-4ed6-b296-dc60943132f7 could not be found. (HTTP 404) (Request-ID: req-0e9dd2d6-e89f-4a2e-b957-dcfab24c0848) May 23 17:17:52.943305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:17:52.943305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:17:52.943305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:17:52.944187 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:17:52.944187 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 23 17:17:52.944187 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 23 17:17:52.944187 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 17:17:52.944187 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 17:17:52.944187 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 17:17:52.944187 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 17:17:52.944187 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 17:17:52.944187 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 17:17:52.944187 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 17:17:52.944187 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 17:17:52.944187 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 17:17:52.944187 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 17:17:52.944187 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 17:17:52.944187 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 17:17:52.944187 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 17:17:52.944187 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 17:17:52.944187 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 17:17:52.944187 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 17:17:52.945083 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 17:17:52.945083 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 17:17:52.945083 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 17:17:52.945083 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 17:17:52.945083 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 723be79d-d12c-4ed6-b296-dc60943132f7 could not be found. May 23 17:17:52.945083 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:17:52.945083 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:17:52.945083 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:17:52.945083 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:17:52.945083 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:17:52.945083 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:17:52.945083 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:17:52.945083 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:17:52.945083 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 17:17:52.945083 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 17:17:52.945083 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:17:52.945083 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:17:52.945083 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 23 17:17:52.945083 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:17:52.945992 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 723be79d-d12c-4ed6-b296-dc60943132f7 could not be found. May 23 17:17:52.945992 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:17:52.945992 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:17:52.945992 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:17:52.945992 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:17:52.945992 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:17:52.945992 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:17:52.945992 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:17:52.945992 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:17:52.945992 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 723be79d-d12c-4ed6-b296-dc60943132f7 could not be found. May 23 17:17:52.945992 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:17:52.945992 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-3ff2fa0b-ef20-42ec-a2f0-cf5029aa4bb2 tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] Returning 404 to user: Volume 723be79d-d12c-4ed6-b296-dc60943132f7 could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:17:52.945992 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-3ff2fa0b-ef20-42ec-a2f0-cf5029aa4bb2 tempest-VolumesSnapshotsTestJSON-848672019 tempest-VolumesSnapshotsTestJSON-848672019-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/723be79d-d12c-4ed6-b296-dc60943132f7" status: 404 len: 109 microversion: 2.1 time: 0.064638 May 23 17:17:52.945992 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 21/42] 10.222.0.46 () {58 vars in 1244 bytes} [Mon May 23 17:17:52 2022] GET /compute/v2.1/os-volumes/723be79d-d12c-4ed6-b296-dc60943132f7 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:17:53.399693 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-522c1ab0-4083-4d2a-93fe-ac1b60a27703 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:17:53.400564 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-522c1ab0-4083-4d2a-93fe-ac1b60a27703 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] [instance: 531aeff0-e028-4f24-9d36-a48492b18414] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:17:53.415931 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-522c1ab0-4083-4d2a-93fe-ac1b60a27703 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:17:53.422311 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-522c1ab0-4083-4d2a-93fe-ac1b60a27703 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:17:53.423491 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-522c1ab0-4083-4d2a-93fe-ac1b60a27703 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:17:53.424142 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-522c1ab0-4083-4d2a-93fe-ac1b60a27703 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:17:53.671787 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=2 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:53.919172 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-522c1ab0-4083-4d2a-93fe-ac1b60a27703 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0429f5d2715a4487a39281edbd941fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd50da000f94eeca1c4f6ab9867d4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:17:53.932151 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-522c1ab0-4083-4d2a-93fe-ac1b60a27703 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] 10.222.0.46 "GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414" status: 200 len: 1273 microversion: 2.1 time: 0.533493 May 23 17:17:53.937391 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 22/43] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:17:53 2022] GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414 => generated 1273 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:17:54.325184 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-fc14ce9b-9296-4326-9eac-9b3ae938ca6e tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Action: 'create', calling method: .version_select at 0x7fd7a1aadaf0>, body: {"keypair": {"name": "tempest-keypair-1281113625", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJB8d34DblFmYu3Ei730GhtwUaD3GehT1Z4sfC8anSYlfG9GfHjny3NnJ9ksUrqtCd9ij3zeB5SiGaeUlIcl68tcCZQrLjz/7JemWP7Yjur0cO7xjdzOmd32vhvNDQ+aQ=="}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:17:54.455642 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-fc14ce9b-9296-4326-9eac-9b3ae938ca6e tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Getting quotas for project 5724b98399214909a99dec90c2718c44. Resources: {'key_pairs'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 17:17:54.464912 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-fc14ce9b-9296-4326-9eac-9b3ae938ca6e tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Getting quotas for user 8485b40daa3347d3a438c2006d9d4ef5 and project 5724b98399214909a99dec90c2718c44. Resources: {'key_pairs'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 17:17:54.569784 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-fc14ce9b-9296-4326-9eac-9b3ae938ca6e tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.399032 May 23 17:17:54.571388 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 22/44] 10.222.0.46 () {62 vars in 1199 bytes} [Mon May 23 17:17:53 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1401 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 23 17:17:54.955139 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-95df082a-c6db-4fb8-bef5-1ee1912fdfcb tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:17:54.956684 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-95df082a-c6db-4fb8-bef5-1ee1912fdfcb tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] [instance: 531aeff0-e028-4f24-9d36-a48492b18414] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:17:54.959055 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=8 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:17:54.971731 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-95df082a-c6db-4fb8-bef5-1ee1912fdfcb tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:17:54.984128 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-95df082a-c6db-4fb8-bef5-1ee1912fdfcb tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:17:54.991103 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-95df082a-c6db-4fb8-bef5-1ee1912fdfcb tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:17:54.992864 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-95df082a-c6db-4fb8-bef5-1ee1912fdfcb tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:17:56.429711 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-95df082a-c6db-4fb8-bef5-1ee1912fdfcb tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0429f5d2715a4487a39281edbd941fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd50da000f94eeca1c4f6ab9867d4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:17:56.445162 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-95df082a-c6db-4fb8-bef5-1ee1912fdfcb tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] 10.222.0.46 "GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414" status: 200 len: 1315 microversion: 2.1 time: 1.495346 May 23 17:17:56.445758 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 23/45] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:17:54 2022] GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414 => generated 1315 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:17:57.476495 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-480273d2-63ad-4443-914a-9f0377ba0851 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:17:57.477852 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-480273d2-63ad-4443-914a-9f0377ba0851 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] [instance: 531aeff0-e028-4f24-9d36-a48492b18414] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:17:57.491112 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-480273d2-63ad-4443-914a-9f0377ba0851 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:17:57.497071 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-480273d2-63ad-4443-914a-9f0377ba0851 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:17:57.498256 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-480273d2-63ad-4443-914a-9f0377ba0851 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:17:57.498850 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-480273d2-63ad-4443-914a-9f0377ba0851 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:17:58.288084 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-480273d2-63ad-4443-914a-9f0377ba0851 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0429f5d2715a4487a39281edbd941fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd50da000f94eeca1c4f6ab9867d4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:17:58.305238 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-480273d2-63ad-4443-914a-9f0377ba0851 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] 10.222.0.46 "GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414" status: 200 len: 1315 microversion: 2.1 time: 0.846225 May 23 17:17:58.313734 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 23/46] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:17:57 2022] GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414 => generated 1315 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:17:59.330519 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e9112672-bda5-4eed-a323-9da0205596b9 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:17:59.331422 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e9112672-bda5-4eed-a323-9da0205596b9 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] [instance: 531aeff0-e028-4f24-9d36-a48492b18414] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:17:59.352350 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e9112672-bda5-4eed-a323-9da0205596b9 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:17:59.355699 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e9112672-bda5-4eed-a323-9da0205596b9 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:17:59.358244 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e9112672-bda5-4eed-a323-9da0205596b9 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:17:59.358244 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e9112672-bda5-4eed-a323-9da0205596b9 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:17:59.762857 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-fa6f96bc-b2d5-4db3-bf95-84ea7ce353e0 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1546626653", "imageRef": "99870172-61a4-4218-9407-6a6da3fb5c83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:17:59.926906 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.network.neutron [None req-fa6f96bc-b2d5-4db3-bf95-84ea7ce353e0 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] validate_networks() for [('257b1a33-3119-4811-9395-bd6f39340e2d', None, None, None, None, None)] {{(pid=117910) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 17:18:00.121301 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e9112672-bda5-4eed-a323-9da0205596b9 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0429f5d2715a4487a39281edbd941fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd50da000f94eeca1c4f6ab9867d4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:00.133597 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e9112672-bda5-4eed-a323-9da0205596b9 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] 10.222.0.46 "GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414" status: 200 len: 1315 microversion: 2.1 time: 0.805233 May 23 17:18:00.133597 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 24/47] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:17:59 2022] GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414 => generated 1315 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:01.671890 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-65de2fde-55da-48d5-b65e-bb29ba29bc4e tempest-VolumesNegativeTest-567016012 tempest-VolumesNegativeTest-567016012-project] Action: 'create', calling method: .version_select at 0x7fd7a123c1f0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-807222493", "metadata": {"Type": "work"}}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:18:01.683391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-65de2fde-55da-48d5-b65e-bb29ba29bc4e tempest-VolumesNegativeTest-567016012 tempest-VolumesNegativeTest-567016012-project] Request method failure captured: May 23 17:18:01.683391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 23 17:18:01.683391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept: application/json May 23 17:18:01.683391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity May 23 17:18:01.683391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Connection: close May 23 17:18:01.683391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Length: 121 May 23 17:18:01.683391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Type: application/json May 23 17:18:01.683391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Host: 10.222.0.46 May 23 17:18:01.683391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None May 23 17:18:01.683391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.9 May 23 17:18:01.683391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABii8HI7-ONXx1ljHy-sTbHlVFyZbSmx_0rfTuiQKbfxlP6JpgP_1ZzNMLt8aGBkiPMi4PkZXRDkgJBp1SMLPGa2Eyel8_Bqfr52oEJR7TcvAPb6qeCHQ6Z-2tuzhzfMe9j7H6f6yfuUBZ8X04dp8qK64dURHBWnbFu7VekB5GkEYWNL10 May 23 17:18:01.683391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Id: None May 23 17:18:01.683391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Name: None May 23 17:18:01.683391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed May 23 17:18:01.683391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True May 23 17:18:01.683391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default May 23 17:18:01.683391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default May 23 17:18:01.683391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Id: 95f843d7f5e34140b3a56366f170528f May 23 17:18:01.683391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-VolumesNegativeTest-567016012 May 23 17:18:01.683391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Role: reader,member May 23 17:18:01.683391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Roles: reader,member May 23 17:18:01.684783 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/95f843d7f5e34140b3a56366f170528f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/95f843d7f5e34140b3a56366f170528f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/95f843d7f5e34140b3a56366f170528f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_95f843d7f5e34140b3a56366f170528f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:18:01.684783 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-VolumesNegativeTest-567016012 May 23 17:18:01.684783 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 95f843d7f5e34140b3a56366f170528f May 23 17:18:01.684783 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-VolumesNegativeTest-567016012 May 23 17:18:01.684783 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User: tempest-VolumesNegativeTest-567016012-project May 23 17:18:01.684783 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default May 23 17:18:01.684783 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default May 23 17:18:01.684783 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Id: 5d786c2bc1a546cb88524bf03a49938c May 23 17:18:01.684783 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-VolumesNegativeTest-567016012-project May 23 17:18:01.684783 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: May 23 17:18:01.684783 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-807222493", "metadata": {"Type": "work"}}} May 23 17:18:01.684783 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: method: May 23 17:18:01.684783 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 23 17:18:01.685643 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-807222493', 'metadata': {'Type': 'work'}}}} May 23 17:18:01.685643 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:18:01.685643 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:18:01.685643 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 23 17:18:01.685643 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 23 17:18:01.685643 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 23 17:18:01.685643 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise error May 23 17:18:01.685643 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 23 17:18:01.685643 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:18:01.685643 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 23 17:18:01.685643 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 23 17:18:01.685643 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:18:01.685643 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi On instance['volume']: May 23 17:18:01.685643 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi '#$%' May 23 17:18:01.685643 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:18:01.685643 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:18:01.685643 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:18:01.685643 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:18:01.685643 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:18:01.685643 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:18:01.685643 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:18:01.685643 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:18:01.686875 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 17:18:01.686875 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 17:18:01.686875 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:18:01.686875 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:18:01.686875 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 23 17:18:01.686875 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 23 17:18:01.686875 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 23 17:18:01.686875 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 23 17:18:01.686875 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 23 17:18:01.686875 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 23 17:18:01.686875 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 23 17:18:01.686875 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:18:01.686875 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:18:01.686875 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:18:01.686875 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:18:01.686875 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:18:01.686875 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:18:01.686875 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 23 17:18:01.686875 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 23 17:18:01.687868 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 23 17:18:01.687868 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:18:01.691448 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-65de2fde-55da-48d5-b65e-bb29ba29bc4e tempest-VolumesNegativeTest-567016012 tempest-VolumesNegativeTest-567016012-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:18:01.694148 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-65de2fde-55da-48d5-b65e-bb29ba29bc4e tempest-VolumesNegativeTest-567016012 tempest-VolumesNegativeTest-567016012-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.883449 May 23 17:18:01.694966 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 25/48] 10.222.0.46 () {60 vars in 1155 bytes} [Mon May 23 17:18:00 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 886 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 23 17:18:01.729856 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e210ac9e-f3a8-4bd7-bdf6-aa3fece8768b tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:01.733239 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e210ac9e-f3a8-4bd7-bdf6-aa3fece8768b tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] [instance: 531aeff0-e028-4f24-9d36-a48492b18414] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:01.756973 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e210ac9e-f3a8-4bd7-bdf6-aa3fece8768b tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:01.757726 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e210ac9e-f3a8-4bd7-bdf6-aa3fece8768b tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:01.759769 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e210ac9e-f3a8-4bd7-bdf6-aa3fece8768b tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:01.762194 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e210ac9e-f3a8-4bd7-bdf6-aa3fece8768b tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:02.556126 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-fa6f96bc-b2d5-4db3-bf95-84ea7ce353e0 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Flavor limits 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 17:18:02.556798 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-fa6f96bc-b2d5-4db3-bf95-84ea7ce353e0 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Image limits 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 17:18:02.559832 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-fa6f96bc-b2d5-4db3-bf95-84ea7ce353e0 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Flavor pref 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 17:18:02.560574 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-fa6f96bc-b2d5-4db3-bf95-84ea7ce353e0 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Image pref 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 17:18:02.561100 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-fa6f96bc-b2d5-4db3-bf95-84ea7ce353e0 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 17:18:02.590847 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fa6f96bc-b2d5-4db3-bf95-84ea7ce353e0 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:02.592437 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fa6f96bc-b2d5-4db3-bf95-84ea7ce353e0 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:02.593380 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fa6f96bc-b2d5-4db3-bf95-84ea7ce353e0 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:02.593832 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fa6f96bc-b2d5-4db3-bf95-84ea7ce353e0 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:02.678892 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e210ac9e-f3a8-4bd7-bdf6-aa3fece8768b tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0429f5d2715a4487a39281edbd941fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd50da000f94eeca1c4f6ab9867d4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:02.704959 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e210ac9e-f3a8-4bd7-bdf6-aa3fece8768b tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] 10.222.0.46 "GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414" status: 200 len: 1315 microversion: 2.1 time: 1.001280 May 23 17:18:02.709893 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 26/49] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:01 2022] GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414 => generated 1315 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:02.722479 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-fa6f96bc-b2d5-4db3-bf95-84ea7ce353e0 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Getting quotas for project 9b1709bec893431599352cb6e470cf76. Resources: {'cores', 'instances', 'ram'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 17:18:02.748262 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-fa6f96bc-b2d5-4db3-bf95-84ea7ce353e0 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Getting quotas for user 8c5d1f4f0bec40ad8e325f8f92739b4d and project 9b1709bec893431599352cb6e470cf76. Resources: {'cores', 'instances', 'ram'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 17:18:02.761648 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-61764441-8ba1-4828-bf5f-7932eb220424 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-948647216", "imageRef": "99870172-61a4-4218-9407-6a6da3fb5c83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "24a76815-79f9-4055-b7f1-41c72b5eca6c"}], "security_groups": [{"name": "tempest-securitygroup--1014784234"}], "key_name": "tempest-keypair-1281113625", "user_data": "}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:18:02.818471 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-fa6f96bc-b2d5-4db3-bf95-84ea7ce353e0 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Going to run 1 instances... {{(pid=117910) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 17:18:02.846457 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-fa6f96bc-b2d5-4db3-bf95-84ea7ce353e0 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: e7b61ab9-ad21-427d-a451-1f721fb3a84c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99870172-61a4-4218-9407-6a6da3fb5c83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117910) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 17:18:03.120444 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-fa6f96bc-b2d5-4db3-bf95-84ea7ce353e0 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.052453 May 23 17:18:03.123694 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 24/50] 10.222.0.46 () {60 vars in 1146 bytes} [Mon May 23 17:17:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 4062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 17:18:03.150376 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-9ba87b71-7314-4150-a78c-9eb8eff0fc9f tempest-VolumesNegativeTest-567016012 tempest-VolumesNegativeTest-567016012-project] Action: 'create', calling method: .version_select at 0x7fd7a09a80d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1779498264", "metadata": {"Type": "work"}}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:18:03.174677 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-9ba87b71-7314-4150-a78c-9eb8eff0fc9f tempest-VolumesNegativeTest-567016012 tempest-VolumesNegativeTest-567016012-project] Request method failure captured: May 23 17:18:03.174677 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 23 17:18:03.174677 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept: application/json May 23 17:18:03.174677 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity May 23 17:18:03.174677 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Connection: close May 23 17:18:03.174677 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Length: 120 May 23 17:18:03.174677 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Type: application/json May 23 17:18:03.174677 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Host: 10.222.0.46 May 23 17:18:03.174677 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None May 23 17:18:03.174677 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.9 May 23 17:18:03.174677 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABii8HI7-ONXx1ljHy-sTbHlVFyZbSmx_0rfTuiQKbfxlP6JpgP_1ZzNMLt8aGBkiPMi4PkZXRDkgJBp1SMLPGa2Eyel8_Bqfr52oEJR7TcvAPb6qeCHQ6Z-2tuzhzfMe9j7H6f6yfuUBZ8X04dp8qK64dURHBWnbFu7VekB5GkEYWNL10 May 23 17:18:03.174677 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Id: None May 23 17:18:03.174677 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Name: None May 23 17:18:03.174677 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed May 23 17:18:03.174677 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True May 23 17:18:03.174677 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default May 23 17:18:03.174677 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default May 23 17:18:03.174677 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Id: 95f843d7f5e34140b3a56366f170528f May 23 17:18:03.174677 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-VolumesNegativeTest-567016012 May 23 17:18:03.174677 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Role: reader,member May 23 17:18:03.174677 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Roles: reader,member May 23 17:18:03.175917 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/95f843d7f5e34140b3a56366f170528f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/95f843d7f5e34140b3a56366f170528f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/95f843d7f5e34140b3a56366f170528f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_95f843d7f5e34140b3a56366f170528f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:18:03.175917 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-VolumesNegativeTest-567016012 May 23 17:18:03.175917 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 95f843d7f5e34140b3a56366f170528f May 23 17:18:03.175917 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-VolumesNegativeTest-567016012 May 23 17:18:03.175917 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User: tempest-VolumesNegativeTest-567016012-project May 23 17:18:03.175917 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default May 23 17:18:03.175917 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default May 23 17:18:03.175917 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Id: 5d786c2bc1a546cb88524bf03a49938c May 23 17:18:03.175917 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-VolumesNegativeTest-567016012-project May 23 17:18:03.175917 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: May 23 17:18:03.175917 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1779498264", "metadata": {"Type": "work"}}} May 23 17:18:03.175917 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: method: May 23 17:18:03.175917 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 23 17:18:03.176639 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1779498264', 'metadata': {'Type': 'work'}}}} May 23 17:18:03.176639 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:18:03.176639 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:18:03.176639 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 23 17:18:03.176639 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 23 17:18:03.176639 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 23 17:18:03.176639 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise error May 23 17:18:03.176639 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 23 17:18:03.176639 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:03.176639 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 23 17:18:03.176639 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 23 17:18:03.176639 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:03.176639 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi On instance['volume']: May 23 17:18:03.176639 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi '0' May 23 17:18:03.176639 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:03.176639 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:18:03.176639 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:03.176639 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:18:03.176639 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:18:03.176639 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:18:03.176639 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:18:03.176639 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:18:03.177817 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 17:18:03.177817 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 17:18:03.177817 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:18:03.177817 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:18:03.177817 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 23 17:18:03.177817 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 23 17:18:03.177817 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 23 17:18:03.177817 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 23 17:18:03.177817 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 23 17:18:03.177817 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 23 17:18:03.177817 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 23 17:18:03.177817 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:03.177817 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:18:03.177817 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:03.177817 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:18:03.177817 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:18:03.177817 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:18:03.177817 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 23 17:18:03.177817 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 23 17:18:03.178791 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 23 17:18:03.178791 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:03.178791 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-9ba87b71-7314-4150-a78c-9eb8eff0fc9f tempest-VolumesNegativeTest-567016012 tempest-VolumesNegativeTest-567016012-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:18:03.178791 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-9ba87b71-7314-4150-a78c-9eb8eff0fc9f tempest-VolumesNegativeTest-567016012 tempest-VolumesNegativeTest-567016012-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.048460 May 23 17:18:03.178791 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 25/51] 10.222.0.46 () {60 vars in 1155 bytes} [Mon May 23 17:18:03 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 17:18:03.572687 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.network.neutron [None req-61764441-8ba1-4828-bf5f-7932eb220424 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] validate_networks() for [('24a76815-79f9-4055-b7f1-41c72b5eca6c', None, None, None, None, None)] {{(pid=117909) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 17:18:03.723866 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-b8d9eda6-e9af-4366-8fe6-79c0fdaf1d36 req-cf10ade1-1c26-4d9c-8859-efaf8687b10b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "531aeff0-e028-4f24-9d36-a48492b18414", "tag": "5629b784-503a-468a-9ee8-3b6e4a0d377d"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:18:03.762146 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-b8d9eda6-e9af-4366-8fe6-79c0fdaf1d36 req-cf10ade1-1c26-4d9c-8859-efaf8687b10b service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:03.762608 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-b8d9eda6-e9af-4366-8fe6-79c0fdaf1d36 req-cf10ade1-1c26-4d9c-8859-efaf8687b10b service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:03.816797 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-b8d9eda6-e9af-4366-8fe6-79c0fdaf1d36 req-cf10ade1-1c26-4d9c-8859-efaf8687b10b service nova] Creating event network-changed:5629b784-503a-468a-9ee8-3b6e4a0d377d for instance 531aeff0-e028-4f24-9d36-a48492b18414 on hv-cinder-84299 May 23 17:18:03.817349 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-b8d9eda6-e9af-4366-8fe6-79c0fdaf1d36 req-cf10ade1-1c26-4d9c-8859-efaf8687b10b service nova] Acquired lock "compute-rpcapi-router" {{(pid=117910) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 23 17:18:03.820583 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a86ce74c-8d00-4c04-b24a-dbdfe0ae8743 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:03.821063 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a86ce74c-8d00-4c04-b24a-dbdfe0ae8743 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:03.822454 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a86ce74c-8d00-4c04-b24a-dbdfe0ae8743 None None] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:03.823573 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a86ce74c-8d00-4c04-b24a-dbdfe0ae8743 None None] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:03.844242 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.compute.rpcapi [None req-a86ce74c-8d00-4c04-b24a-dbdfe0ae8743 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 23 17:18:03.845872 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a86ce74c-8d00-4c04-b24a-dbdfe0ae8743 None None] Releasing lock "compute-rpcapi-router" {{(pid=117910) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 23 17:18:03.898855 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-a86ce74c-8d00-4c04-b24a-dbdfe0ae8743 None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.709301 May 23 17:18:03.906143 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 26/52] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:18:03.935168 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-328d98c3-75b0-411e-ba83-12c44eb9636e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:03.939025 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-328d98c3-75b0-411e-ba83-12c44eb9636e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: e7b61ab9-ad21-427d-a451-1f721fb3a84c] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:04.482921 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=6 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:04.658061 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-328d98c3-75b0-411e-ba83-12c44eb9636e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:04.671705 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-328d98c3-75b0-411e-ba83-12c44eb9636e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c" status: 200 len: 1222 microversion: 2.1 time: 0.760660 May 23 17:18:04.674578 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 27/53] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:03 2022] GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c => generated 1222 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:04.686186 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b7fe78c0-c037-4945-8319-059a9a0ee0de tempest-VolumesNegativeTest-567016012 tempest-VolumesNegativeTest-567016012-project] Action: 'create', calling method: .version_select at 0x7fd7a09bd430>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-212294333", "metadata": {"Type": "work"}}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:18:04.692153 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b7fe78c0-c037-4945-8319-059a9a0ee0de tempest-VolumesNegativeTest-567016012 tempest-VolumesNegativeTest-567016012-project] Request method failure captured: May 23 17:18:04.692153 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 23 17:18:04.692153 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept: application/json May 23 17:18:04.692153 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity May 23 17:18:04.692153 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Connection: close May 23 17:18:04.692153 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Length: 118 May 23 17:18:04.692153 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Type: application/json May 23 17:18:04.692153 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Host: 10.222.0.46 May 23 17:18:04.692153 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None May 23 17:18:04.692153 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.9 May 23 17:18:04.692153 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABii8HI7-ONXx1ljHy-sTbHlVFyZbSmx_0rfTuiQKbfxlP6JpgP_1ZzNMLt8aGBkiPMi4PkZXRDkgJBp1SMLPGa2Eyel8_Bqfr52oEJR7TcvAPb6qeCHQ6Z-2tuzhzfMe9j7H6f6yfuUBZ8X04dp8qK64dURHBWnbFu7VekB5GkEYWNL10 May 23 17:18:04.692153 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Id: None May 23 17:18:04.692153 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Name: None May 23 17:18:04.692153 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed May 23 17:18:04.692153 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True May 23 17:18:04.692153 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default May 23 17:18:04.692153 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default May 23 17:18:04.692153 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Id: 95f843d7f5e34140b3a56366f170528f May 23 17:18:04.692153 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-VolumesNegativeTest-567016012 May 23 17:18:04.692153 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Role: reader,member May 23 17:18:04.692153 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Roles: reader,member May 23 17:18:04.693767 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/95f843d7f5e34140b3a56366f170528f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/95f843d7f5e34140b3a56366f170528f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/95f843d7f5e34140b3a56366f170528f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_95f843d7f5e34140b3a56366f170528f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:18:04.693767 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-VolumesNegativeTest-567016012 May 23 17:18:04.693767 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 95f843d7f5e34140b3a56366f170528f May 23 17:18:04.693767 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-VolumesNegativeTest-567016012 May 23 17:18:04.693767 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User: tempest-VolumesNegativeTest-567016012-project May 23 17:18:04.693767 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default May 23 17:18:04.693767 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default May 23 17:18:04.693767 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Id: 5d786c2bc1a546cb88524bf03a49938c May 23 17:18:04.693767 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-VolumesNegativeTest-567016012-project May 23 17:18:04.693767 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: May 23 17:18:04.693767 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-212294333", "metadata": {"Type": "work"}}} May 23 17:18:04.693767 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: method: May 23 17:18:04.693767 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 23 17:18:04.694578 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-212294333', 'metadata': {'Type': 'work'}}}} May 23 17:18:04.694578 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:18:04.694578 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:18:04.694578 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 23 17:18:04.694578 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 23 17:18:04.694578 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 23 17:18:04.694578 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise error May 23 17:18:04.694578 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 23 17:18:04.694578 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:04.694578 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 23 17:18:04.694578 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 23 17:18:04.694578 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:04.694578 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi On instance['volume']: May 23 17:18:04.694578 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi '' May 23 17:18:04.694578 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:04.694578 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:18:04.694578 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:04.694578 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:18:04.694578 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:18:04.694578 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:18:04.694578 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:18:04.694578 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:18:04.696018 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 17:18:04.696018 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 17:18:04.696018 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:18:04.696018 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:18:04.696018 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 23 17:18:04.696018 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 23 17:18:04.696018 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 23 17:18:04.696018 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 23 17:18:04.696018 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 23 17:18:04.696018 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 23 17:18:04.696018 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 23 17:18:04.696018 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:04.696018 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:18:04.696018 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:04.696018 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:18:04.696018 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:18:04.696018 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:18:04.696018 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 23 17:18:04.696018 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 23 17:18:04.697236 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 23 17:18:04.697236 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:04.697236 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b7fe78c0-c037-4945-8319-059a9a0ee0de tempest-VolumesNegativeTest-567016012 tempest-VolumesNegativeTest-567016012-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:18:04.697236 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b7fe78c0-c037-4945-8319-059a9a0ee0de tempest-VolumesNegativeTest-567016012 tempest-VolumesNegativeTest-567016012-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.016083 May 23 17:18:04.713815 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 28/54] 10.222.0.46 () {60 vars in 1155 bytes} [Mon May 23 17:18:04 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 17:18:04.733803 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d56eca29-5943-466b-8096-627973171e50 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:04.742429 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d56eca29-5943-466b-8096-627973171e50 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] [instance: 531aeff0-e028-4f24-9d36-a48492b18414] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:04.770530 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d56eca29-5943-466b-8096-627973171e50 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:04.771775 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d56eca29-5943-466b-8096-627973171e50 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:04.774025 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d56eca29-5943-466b-8096-627973171e50 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:04.775871 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d56eca29-5943-466b-8096-627973171e50 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:05.341069 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d56eca29-5943-466b-8096-627973171e50 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0429f5d2715a4487a39281edbd941fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd50da000f94eeca1c4f6ab9867d4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:05.353892 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d56eca29-5943-466b-8096-627973171e50 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] 10.222.0.46 "GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414" status: 200 len: 1315 microversion: 2.1 time: 0.631789 May 23 17:18:05.361737 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 29/55] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:04 2022] GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414 => generated 1315 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:05.369809 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-818f8bd9-a536-409e-b62a-708421540aa5 tempest-VolumesNegativeTest-567016012 tempest-VolumesNegativeTest-567016012-project] Calling method '.version_select at 0x7fd7a0a27ca0>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:05.469232 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-818f8bd9-a536-409e-b62a-708421540aa5 tempest-VolumesNegativeTest-567016012 tempest-VolumesNegativeTest-567016012-project] HTTP exception thrown: Volume tempest-invalid-1695410695 could not be found. May 23 17:18:05.471791 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-818f8bd9-a536-409e-b62a-708421540aa5 tempest-VolumesNegativeTest-567016012 tempest-VolumesNegativeTest-567016012-project] Request method failure captured: May 23 17:18:05.471791 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1695410695 HTTP/1.1 May 23 17:18:05.471791 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept: application/json May 23 17:18:05.471791 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity May 23 17:18:05.471791 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Connection: close May 23 17:18:05.471791 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Length: 0 May 23 17:18:05.471791 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Type: application/json May 23 17:18:05.471791 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Host: 10.222.0.46 May 23 17:18:05.471791 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None May 23 17:18:05.471791 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.9 May 23 17:18:05.471791 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABii8HI7-ONXx1ljHy-sTbHlVFyZbSmx_0rfTuiQKbfxlP6JpgP_1ZzNMLt8aGBkiPMi4PkZXRDkgJBp1SMLPGa2Eyel8_Bqfr52oEJR7TcvAPb6qeCHQ6Z-2tuzhzfMe9j7H6f6yfuUBZ8X04dp8qK64dURHBWnbFu7VekB5GkEYWNL10 May 23 17:18:05.471791 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Id: None May 23 17:18:05.471791 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Name: None May 23 17:18:05.471791 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed May 23 17:18:05.471791 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True May 23 17:18:05.471791 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default May 23 17:18:05.471791 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default May 23 17:18:05.471791 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Id: 95f843d7f5e34140b3a56366f170528f May 23 17:18:05.471791 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-VolumesNegativeTest-567016012 May 23 17:18:05.471791 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Role: reader,member May 23 17:18:05.471791 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Roles: reader,member May 23 17:18:05.472983 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/95f843d7f5e34140b3a56366f170528f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/95f843d7f5e34140b3a56366f170528f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/95f843d7f5e34140b3a56366f170528f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_95f843d7f5e34140b3a56366f170528f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:18:05.472983 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-VolumesNegativeTest-567016012 May 23 17:18:05.472983 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 95f843d7f5e34140b3a56366f170528f May 23 17:18:05.472983 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-VolumesNegativeTest-567016012 May 23 17:18:05.472983 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User: tempest-VolumesNegativeTest-567016012-project May 23 17:18:05.472983 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default May 23 17:18:05.472983 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default May 23 17:18:05.472983 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Id: 5d786c2bc1a546cb88524bf03a49938c May 23 17:18:05.472983 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-VolumesNegativeTest-567016012-project May 23 17:18:05.472983 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: method: May 23 17:18:05.472983 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: exception: Volume tempest-invalid-1695410695 could not be found. May 23 17:18:05.472983 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: action_args: {'id': 'tempest-invalid-1695410695'} May 23 17:18:05.472983 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:18:05.473700 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:18:05.473700 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 17:18:05.473700 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 17:18:05.473700 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 17:18:05.473700 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 17:18:05.473700 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 17:18:05.473700 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 17:18:05.473700 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 17:18:05.473700 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 17:18:05.473700 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 17:18:05.473700 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 17:18:05.473700 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 17:18:05.473700 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 17:18:05.473700 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 17:18:05.473700 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 17:18:05.473700 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1695410695 could not be found. (HTTP 404) (Request-ID: req-f4d4b32a-fd8b-4282-aeff-b2dec59846b1) May 23 17:18:05.473700 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:05.473700 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:18:05.473700 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:05.475318 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:18:05.475318 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 23 17:18:05.475318 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 23 17:18:05.475318 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 17:18:05.475318 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 17:18:05.475318 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 17:18:05.475318 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 17:18:05.475318 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 17:18:05.475318 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 17:18:05.475318 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 17:18:05.475318 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 17:18:05.475318 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 17:18:05.475318 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 17:18:05.475318 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 17:18:05.475318 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 17:18:05.475318 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 17:18:05.475318 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 17:18:05.475318 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 17:18:05.475318 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 17:18:05.477354 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 17:18:05.477354 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 17:18:05.477354 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 17:18:05.477354 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 17:18:05.477354 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1695410695 could not be found. May 23 17:18:05.477354 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:05.477354 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:18:05.477354 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:05.477354 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:18:05.477354 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:18:05.477354 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:18:05.477354 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:18:05.477354 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:18:05.477354 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 17:18:05.477354 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 17:18:05.477354 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:18:05.477354 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:18:05.477354 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 23 17:18:05.477354 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:18:05.477354 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1695410695 could not be found. May 23 17:18:05.479727 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:05.479727 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:18:05.479727 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:05.479727 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:18:05.479727 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:18:05.479727 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:18:05.479727 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:18:05.479727 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:18:05.479727 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1695410695 could not be found. May 23 17:18:05.479727 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:05.479727 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-818f8bd9-a536-409e-b62a-708421540aa5 tempest-VolumesNegativeTest-567016012 tempest-VolumesNegativeTest-567016012-project] Returning 404 to user: Volume tempest-invalid-1695410695 could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:18:05.479727 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-818f8bd9-a536-409e-b62a-708421540aa5 tempest-VolumesNegativeTest-567016012 tempest-VolumesNegativeTest-567016012-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1695410695" status: 404 len: 99 microversion: 2.1 time: 0.110312 May 23 17:18:05.479727 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 30/56] 10.222.0.46 () {58 vars in 1217 bytes} [Mon May 23 17:18:05 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1695410695 => generated 99 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 23 17:18:05.489765 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-11f13dd8-9ec7-4887-b097-f4b4a47e6607 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-952691626", "imageRef": "99870172-61a4-4218-9407-6a6da3fb5c83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:18:05.637968 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.network.neutron [None req-11f13dd8-9ec7-4887-b097-f4b4a47e6607 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] validate_networks() for [('257b1a33-3119-4811-9395-bd6f39340e2d', None, None, None, None, None)] {{(pid=117910) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 17:18:07.342885 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-61764441-8ba1-4828-bf5f-7932eb220424 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Flavor limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 17:18:07.343537 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-61764441-8ba1-4828-bf5f-7932eb220424 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Image limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 17:18:07.344017 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-61764441-8ba1-4828-bf5f-7932eb220424 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Flavor pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 17:18:07.344491 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-61764441-8ba1-4828-bf5f-7932eb220424 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Image pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 17:18:07.344943 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-61764441-8ba1-4828-bf5f-7932eb220424 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 17:18:07.361236 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-11f13dd8-9ec7-4887-b097-f4b4a47e6607 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Flavor limits 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 17:18:07.363128 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-11f13dd8-9ec7-4887-b097-f4b4a47e6607 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Image limits 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 17:18:07.363971 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-11f13dd8-9ec7-4887-b097-f4b4a47e6607 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Flavor pref 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 17:18:07.364549 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-11f13dd8-9ec7-4887-b097-f4b4a47e6607 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Image pref 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 17:18:07.365238 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-11f13dd8-9ec7-4887-b097-f4b4a47e6607 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 17:18:07.365771 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-61764441-8ba1-4828-bf5f-7932eb220424 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:07.367328 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-61764441-8ba1-4828-bf5f-7932eb220424 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:07.369335 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-61764441-8ba1-4828-bf5f-7932eb220424 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:07.370926 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-61764441-8ba1-4828-bf5f-7932eb220424 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:07.383376 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-11f13dd8-9ec7-4887-b097-f4b4a47e6607 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:07.384144 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-11f13dd8-9ec7-4887-b097-f4b4a47e6607 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:07.385142 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-11f13dd8-9ec7-4887-b097-f4b4a47e6607 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:07.393319 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-11f13dd8-9ec7-4887-b097-f4b4a47e6607 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:07.429450 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-11f13dd8-9ec7-4887-b097-f4b4a47e6607 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Getting quotas for project 9b1709bec893431599352cb6e470cf76. Resources: {'cores', 'instances', 'ram'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 17:18:07.437989 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-11f13dd8-9ec7-4887-b097-f4b4a47e6607 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Getting quotas for user 8c5d1f4f0bec40ad8e325f8f92739b4d and project 9b1709bec893431599352cb6e470cf76. Resources: {'cores', 'instances', 'ram'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 17:18:07.471610 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-11f13dd8-9ec7-4887-b097-f4b4a47e6607 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Going to run 1 instances... {{(pid=117910) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 17:18:07.474273 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-11f13dd8-9ec7-4887-b097-f4b4a47e6607 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99870172-61a4-4218-9407-6a6da3fb5c83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117910) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 17:18:07.553555 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-61764441-8ba1-4828-bf5f-7932eb220424 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Getting quotas for project 5724b98399214909a99dec90c2718c44. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 17:18:07.558405 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-11f13dd8-9ec7-4887-b097-f4b4a47e6607 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.081405 May 23 17:18:07.560569 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 31/57] 10.222.0.46 () {60 vars in 1146 bytes} [Mon May 23 17:18:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 2086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 17:18:07.577256 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-61764441-8ba1-4828-bf5f-7932eb220424 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Getting quotas for user 8485b40daa3347d3a438c2006d9d4ef5 and project 5724b98399214909a99dec90c2718c44. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 17:18:07.584632 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-65451276-ec69-488b-8ba1-df995247747b tempest-VolumesNegativeTest-567016012 tempest-VolumesNegativeTest-567016012-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.018070 May 23 17:18:07.590252 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 32/58] 10.222.0.46 () {58 vars in 1139 bytes} [Mon May 23 17:18:07 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 28 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 23 17:18:07.603570 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-01c00c52-815f-464e-bc05-8c00f6e71756 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:07.604215 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-01c00c52-815f-464e-bc05-8c00f6e71756 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] [instance: 531aeff0-e028-4f24-9d36-a48492b18414] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:07.618809 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-01c00c52-815f-464e-bc05-8c00f6e71756 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:07.620882 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-01c00c52-815f-464e-bc05-8c00f6e71756 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:07.622126 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-01c00c52-815f-464e-bc05-8c00f6e71756 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:07.622797 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-01c00c52-815f-464e-bc05-8c00f6e71756 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:07.639340 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-61764441-8ba1-4828-bf5f-7932eb220424 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Going to run 1 instances... {{(pid=117909) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 17:18:07.658081 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-61764441-8ba1-4828-bf5f-7932eb220424 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99870172-61a4-4218-9407-6a6da3fb5c83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 17:18:07.822645 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-61764441-8ba1-4828-bf5f-7932eb220424 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 5.097513 May 23 17:18:07.824025 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 27/59] 10.222.0.46 () {62 vars in 1187 bytes} [Mon May 23 17:18:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 5113 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 23 17:18:07.832420 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-807b939c-7fb7-4e4c-990e-cba5bd7ff2cf tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:07.833568 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-807b939c-7fb7-4e4c-990e-cba5bd7ff2cf tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:08.070415 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-807b939c-7fb7-4e4c-990e-cba5bd7ff2cf tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:08.085516 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-807b939c-7fb7-4e4c-990e-cba5bd7ff2cf tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1221 microversion: 2.1 time: 0.258881 May 23 17:18:08.086835 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 28/60] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:07 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1221 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:08.100252 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2ab60042-b090-48c8-aa3d-b7c584733388 tempest-VolumesNegativeTest-567016012 tempest-VolumesNegativeTest-567016012-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010662 May 23 17:18:08.105578 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 29/61] 10.222.0.46 () {58 vars in 1136 bytes} [Mon May 23 17:18:08 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 23 17:18:08.118988 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4c6b1e3e-7c0d-4748-b2dc-b5ace8133e52 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:08.121763 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4c6b1e3e-7c0d-4748-b2dc-b5ace8133e52 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:08.127651 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-01c00c52-815f-464e-bc05-8c00f6e71756 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0429f5d2715a4487a39281edbd941fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd50da000f94eeca1c4f6ab9867d4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:08.136497 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-01c00c52-815f-464e-bc05-8c00f6e71756 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] 10.222.0.46 "GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414" status: 200 len: 1315 microversion: 2.1 time: 0.544633 May 23 17:18:08.143323 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 33/62] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:07 2022] GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414 => generated 1315 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:08.148414 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-eafb2866-9630-4115-8060-926e3c21f01d tempest-VolumesNegativeTest-567016012 tempest-VolumesNegativeTest-567016012-project] Calling method '.version_select at 0x7fd7a098d700>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:08.230079 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-eafb2866-9630-4115-8060-926e3c21f01d tempest-VolumesNegativeTest-567016012 tempest-VolumesNegativeTest-567016012-project] HTTP exception thrown: Volume 5f36186e-360d-454a-99cc-e32989d2fcfa could not be found. May 23 17:18:08.232465 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-eafb2866-9630-4115-8060-926e3c21f01d tempest-VolumesNegativeTest-567016012 tempest-VolumesNegativeTest-567016012-project] Request method failure captured: May 23 17:18:08.232465 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: request: DELETE /compute/v2.1/os-volumes/5f36186e-360d-454a-99cc-e32989d2fcfa HTTP/1.1 May 23 17:18:08.232465 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept: application/json May 23 17:18:08.232465 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity May 23 17:18:08.232465 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Connection: close May 23 17:18:08.232465 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Length: 0 May 23 17:18:08.232465 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Type: application/json May 23 17:18:08.232465 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Host: 10.222.0.46 May 23 17:18:08.232465 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None May 23 17:18:08.232465 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.9 May 23 17:18:08.232465 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABii8HI7-ONXx1ljHy-sTbHlVFyZbSmx_0rfTuiQKbfxlP6JpgP_1ZzNMLt8aGBkiPMi4PkZXRDkgJBp1SMLPGa2Eyel8_Bqfr52oEJR7TcvAPb6qeCHQ6Z-2tuzhzfMe9j7H6f6yfuUBZ8X04dp8qK64dURHBWnbFu7VekB5GkEYWNL10 May 23 17:18:08.232465 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Id: None May 23 17:18:08.232465 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Name: None May 23 17:18:08.232465 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed May 23 17:18:08.232465 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True May 23 17:18:08.232465 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default May 23 17:18:08.232465 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default May 23 17:18:08.232465 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Id: 95f843d7f5e34140b3a56366f170528f May 23 17:18:08.232465 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-VolumesNegativeTest-567016012 May 23 17:18:08.232465 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Role: reader,member May 23 17:18:08.232465 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Roles: reader,member May 23 17:18:08.233854 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/95f843d7f5e34140b3a56366f170528f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/95f843d7f5e34140b3a56366f170528f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/95f843d7f5e34140b3a56366f170528f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_95f843d7f5e34140b3a56366f170528f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:18:08.233854 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-VolumesNegativeTest-567016012 May 23 17:18:08.233854 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 95f843d7f5e34140b3a56366f170528f May 23 17:18:08.233854 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-VolumesNegativeTest-567016012 May 23 17:18:08.233854 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User: tempest-VolumesNegativeTest-567016012-project May 23 17:18:08.233854 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default May 23 17:18:08.233854 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default May 23 17:18:08.233854 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Id: 5d786c2bc1a546cb88524bf03a49938c May 23 17:18:08.233854 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-VolumesNegativeTest-567016012-project May 23 17:18:08.233854 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: method: May 23 17:18:08.233854 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: exception: Volume 5f36186e-360d-454a-99cc-e32989d2fcfa could not be found. May 23 17:18:08.233854 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: action_args: {'id': '5f36186e-360d-454a-99cc-e32989d2fcfa'} May 23 17:18:08.233854 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:18:08.234554 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:18:08.234554 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 17:18:08.234554 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 17:18:08.234554 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 17:18:08.234554 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 17:18:08.234554 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 17:18:08.234554 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 17:18:08.234554 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 17:18:08.234554 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 17:18:08.234554 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 17:18:08.234554 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 17:18:08.234554 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 17:18:08.234554 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 17:18:08.234554 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 17:18:08.234554 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 17:18:08.234554 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5f36186e-360d-454a-99cc-e32989d2fcfa could not be found. (HTTP 404) (Request-ID: req-bed9f1f5-8f6c-49c3-88bf-391fd3a1e006) May 23 17:18:08.234554 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:08.234554 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:18:08.234554 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:08.235596 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:18:08.235596 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 23 17:18:08.235596 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 23 17:18:08.235596 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 17:18:08.235596 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 17:18:08.235596 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 17:18:08.235596 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 17:18:08.235596 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 17:18:08.235596 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 17:18:08.235596 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 17:18:08.235596 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 17:18:08.235596 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 17:18:08.235596 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 17:18:08.235596 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 17:18:08.235596 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 17:18:08.235596 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 17:18:08.235596 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 17:18:08.235596 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 17:18:08.235596 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 17:18:08.236630 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 17:18:08.236630 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 17:18:08.236630 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 17:18:08.236630 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 17:18:08.236630 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5f36186e-360d-454a-99cc-e32989d2fcfa could not be found. May 23 17:18:08.236630 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:08.236630 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:18:08.236630 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:08.236630 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:18:08.236630 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:18:08.236630 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:18:08.236630 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:18:08.236630 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:18:08.236630 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 17:18:08.236630 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 17:18:08.236630 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:18:08.236630 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:18:08.236630 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 23 17:18:08.236630 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:18:08.237745 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5f36186e-360d-454a-99cc-e32989d2fcfa could not be found. May 23 17:18:08.237745 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:08.237745 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:18:08.237745 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:08.237745 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:18:08.237745 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:18:08.237745 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:18:08.237745 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:18:08.237745 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:18:08.237745 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5f36186e-360d-454a-99cc-e32989d2fcfa could not be found. May 23 17:18:08.237745 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:08.241285 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-eafb2866-9630-4115-8060-926e3c21f01d tempest-VolumesNegativeTest-567016012 tempest-VolumesNegativeTest-567016012-project] Returning 404 to user: Volume 5f36186e-360d-454a-99cc-e32989d2fcfa could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:18:08.242457 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-eafb2866-9630-4115-8060-926e3c21f01d tempest-VolumesNegativeTest-567016012 tempest-VolumesNegativeTest-567016012-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/5f36186e-360d-454a-99cc-e32989d2fcfa" status: 404 len: 109 microversion: 2.1 time: 0.097802 May 23 17:18:08.243245 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 34/63] 10.222.0.46 () {58 vars in 1247 bytes} [Mon May 23 17:18:08 2022] DELETE /compute/v2.1/os-volumes/5f36186e-360d-454a-99cc-e32989d2fcfa => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:18:08.255601 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-be4dcfeb-af63-4cbd-8a6f-e5484fe6f3ef tempest-VolumesNegativeTest-567016012 tempest-VolumesNegativeTest-567016012-project] Calling method '.version_select at 0x7fd7a09bd0d0>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:08.313748 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4c6b1e3e-7c0d-4748-b2dc-b5ace8133e52 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:08.325672 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4c6b1e3e-7c0d-4748-b2dc-b5ace8133e52 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:08.327301 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4c6b1e3e-7c0d-4748-b2dc-b5ace8133e52 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:08.330298 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-be4dcfeb-af63-4cbd-8a6f-e5484fe6f3ef tempest-VolumesNegativeTest-567016012 tempest-VolumesNegativeTest-567016012-project] HTTP exception thrown: Volume 81f4ba54-e8e7-419c-a127-de0d21ab74c4 could not be found. May 23 17:18:08.332782 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-be4dcfeb-af63-4cbd-8a6f-e5484fe6f3ef tempest-VolumesNegativeTest-567016012 tempest-VolumesNegativeTest-567016012-project] Request method failure captured: May 23 17:18:08.332782 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: request: GET /compute/v2.1/os-volumes/81f4ba54-e8e7-419c-a127-de0d21ab74c4 HTTP/1.1 May 23 17:18:08.332782 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept: application/json May 23 17:18:08.332782 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity May 23 17:18:08.332782 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Connection: close May 23 17:18:08.332782 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Length: 0 May 23 17:18:08.332782 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Type: application/json May 23 17:18:08.332782 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Host: 10.222.0.46 May 23 17:18:08.332782 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None May 23 17:18:08.332782 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.9 May 23 17:18:08.332782 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABii8HI7-ONXx1ljHy-sTbHlVFyZbSmx_0rfTuiQKbfxlP6JpgP_1ZzNMLt8aGBkiPMi4PkZXRDkgJBp1SMLPGa2Eyel8_Bqfr52oEJR7TcvAPb6qeCHQ6Z-2tuzhzfMe9j7H6f6yfuUBZ8X04dp8qK64dURHBWnbFu7VekB5GkEYWNL10 May 23 17:18:08.332782 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Id: None May 23 17:18:08.332782 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Name: None May 23 17:18:08.332782 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed May 23 17:18:08.332782 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True May 23 17:18:08.332782 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default May 23 17:18:08.332782 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default May 23 17:18:08.332782 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Id: 95f843d7f5e34140b3a56366f170528f May 23 17:18:08.332782 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-VolumesNegativeTest-567016012 May 23 17:18:08.332782 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Role: reader,member May 23 17:18:08.332782 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Roles: reader,member May 23 17:18:08.333980 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/95f843d7f5e34140b3a56366f170528f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/95f843d7f5e34140b3a56366f170528f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/95f843d7f5e34140b3a56366f170528f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_95f843d7f5e34140b3a56366f170528f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:18:08.333980 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-VolumesNegativeTest-567016012 May 23 17:18:08.333980 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 95f843d7f5e34140b3a56366f170528f May 23 17:18:08.333980 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-VolumesNegativeTest-567016012 May 23 17:18:08.333980 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User: tempest-VolumesNegativeTest-567016012-project May 23 17:18:08.333980 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default May 23 17:18:08.333980 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default May 23 17:18:08.333980 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Id: 5d786c2bc1a546cb88524bf03a49938c May 23 17:18:08.333980 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-VolumesNegativeTest-567016012-project May 23 17:18:08.333980 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: method: May 23 17:18:08.333980 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: exception: Volume 81f4ba54-e8e7-419c-a127-de0d21ab74c4 could not be found. May 23 17:18:08.333980 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: action_args: {'id': '81f4ba54-e8e7-419c-a127-de0d21ab74c4'} May 23 17:18:08.333980 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:18:08.334648 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:18:08.334648 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 17:18:08.334648 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 17:18:08.334648 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 17:18:08.334648 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 17:18:08.334648 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 17:18:08.334648 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 17:18:08.334648 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 17:18:08.334648 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 17:18:08.334648 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 17:18:08.334648 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 17:18:08.334648 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 17:18:08.334648 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 17:18:08.334648 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 17:18:08.334648 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 17:18:08.334648 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 81f4ba54-e8e7-419c-a127-de0d21ab74c4 could not be found. (HTTP 404) (Request-ID: req-eb9759bf-c408-494d-a745-e63a9b11314f) May 23 17:18:08.334648 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:08.334648 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:18:08.334648 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:08.335604 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:18:08.335604 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 23 17:18:08.335604 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 23 17:18:08.335604 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 17:18:08.335604 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 17:18:08.335604 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 17:18:08.335604 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 17:18:08.335604 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 17:18:08.335604 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 17:18:08.335604 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 17:18:08.335604 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 17:18:08.335604 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 17:18:08.335604 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 17:18:08.335604 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 17:18:08.335604 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 17:18:08.335604 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 17:18:08.335604 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 17:18:08.335604 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 17:18:08.335604 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 17:18:08.337316 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 17:18:08.337316 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 17:18:08.337316 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 17:18:08.337316 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 17:18:08.337316 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 81f4ba54-e8e7-419c-a127-de0d21ab74c4 could not be found. May 23 17:18:08.337316 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:08.337316 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:18:08.337316 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:08.337316 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:18:08.337316 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:18:08.337316 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:18:08.337316 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:18:08.337316 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:18:08.337316 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 17:18:08.337316 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 17:18:08.337316 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:18:08.337316 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:18:08.337316 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 23 17:18:08.337316 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:18:08.338389 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 81f4ba54-e8e7-419c-a127-de0d21ab74c4 could not be found. May 23 17:18:08.338389 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:08.338389 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:18:08.338389 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:08.338389 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:18:08.338389 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:18:08.338389 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:18:08.338389 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:18:08.338389 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:18:08.338389 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 81f4ba54-e8e7-419c-a127-de0d21ab74c4 could not be found. May 23 17:18:08.338389 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:08.338389 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-be4dcfeb-af63-4cbd-8a6f-e5484fe6f3ef tempest-VolumesNegativeTest-567016012 tempest-VolumesNegativeTest-567016012-project] Returning 404 to user: Volume 81f4ba54-e8e7-419c-a127-de0d21ab74c4 could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:18:08.338389 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-be4dcfeb-af63-4cbd-8a6f-e5484fe6f3ef tempest-VolumesNegativeTest-567016012 tempest-VolumesNegativeTest-567016012-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/81f4ba54-e8e7-419c-a127-de0d21ab74c4" status: 404 len: 109 microversion: 2.1 time: 0.085164 May 23 17:18:08.343458 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 35/64] 10.222.0.46 () {58 vars in 1244 bytes} [Mon May 23 17:18:08 2022] GET /compute/v2.1/os-volumes/81f4ba54-e8e7-419c-a127-de0d21ab74c4 => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 17:18:08.353202 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4c6b1e3e-7c0d-4748-b2dc-b5ace8133e52 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1281 microversion: 2.20 time: 0.221254 May 23 17:18:08.359746 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 30/65] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:18:08 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1281 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:18:09.106354 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-9283cfc8-b21b-4b9d-a7bb-35b3b49a7e00 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:09.107630 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-9283cfc8-b21b-4b9d-a7bb-35b3b49a7e00 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:09.114786 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9283cfc8-b21b-4b9d-a7bb-35b3b49a7e00 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:09.119566 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9283cfc8-b21b-4b9d-a7bb-35b3b49a7e00 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:09.121633 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9283cfc8-b21b-4b9d-a7bb-35b3b49a7e00 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:09.122548 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9283cfc8-b21b-4b9d-a7bb-35b3b49a7e00 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:09.161742 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-71ea06b7-5dd6-4f3b-90e1-89ae1f3c5a70 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:09.162540 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-71ea06b7-5dd6-4f3b-90e1-89ae1f3c5a70 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] [instance: 531aeff0-e028-4f24-9d36-a48492b18414] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:09.173638 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-71ea06b7-5dd6-4f3b-90e1-89ae1f3c5a70 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:09.174100 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-71ea06b7-5dd6-4f3b-90e1-89ae1f3c5a70 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:09.176622 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-71ea06b7-5dd6-4f3b-90e1-89ae1f3c5a70 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:09.177918 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-71ea06b7-5dd6-4f3b-90e1-89ae1f3c5a70 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:09.226982 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9283cfc8-b21b-4b9d-a7bb-35b3b49a7e00 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:09.237654 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-9283cfc8-b21b-4b9d-a7bb-35b3b49a7e00 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1273 microversion: 2.1 time: 0.137831 May 23 17:18:09.238492 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 36/66] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:09 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1273 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:18:09.375543 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-43f7d4df-0b19-4f59-beb1-b012f330c470 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:09.376065 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-43f7d4df-0b19-4f59-beb1-b012f330c470 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:09.400183 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-43f7d4df-0b19-4f59-beb1-b012f330c470 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:09.401763 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-43f7d4df-0b19-4f59-beb1-b012f330c470 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:09.405249 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-43f7d4df-0b19-4f59-beb1-b012f330c470 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:09.405845 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-43f7d4df-0b19-4f59-beb1-b012f330c470 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:09.445187 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-71ea06b7-5dd6-4f3b-90e1-89ae1f3c5a70 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0429f5d2715a4487a39281edbd941fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd50da000f94eeca1c4f6ab9867d4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:09.455565 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-71ea06b7-5dd6-4f3b-90e1-89ae1f3c5a70 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] 10.222.0.46 "GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414" status: 200 len: 1315 microversion: 2.1 time: 0.299998 May 23 17:18:09.459501 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 31/67] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:09 2022] GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414 => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:09.594675 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-43f7d4df-0b19-4f59-beb1-b012f330c470 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:09.612969 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-43f7d4df-0b19-4f59-beb1-b012f330c470 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:09.617857 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-43f7d4df-0b19-4f59-beb1-b012f330c470 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:09.621761 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-43f7d4df-0b19-4f59-beb1-b012f330c470 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1277 microversion: 2.20 time: 0.251545 May 23 17:18:09.629052 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 37/68] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:18:09 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1277 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:18:10.254604 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f149d191-245b-452f-801f-8f061021c783 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:10.255613 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f149d191-245b-452f-801f-8f061021c783 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:10.276959 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f149d191-245b-452f-801f-8f061021c783 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:10.285452 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f149d191-245b-452f-801f-8f061021c783 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:10.288742 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f149d191-245b-452f-801f-8f061021c783 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:10.292073 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f149d191-245b-452f-801f-8f061021c783 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:10.474736 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-90e7152b-60ba-4097-b24a-8ecaff4caf61 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:10.475917 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-90e7152b-60ba-4097-b24a-8ecaff4caf61 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] [instance: 531aeff0-e028-4f24-9d36-a48492b18414] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:10.479142 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=9 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:10.485912 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f149d191-245b-452f-801f-8f061021c783 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:10.488542 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=43 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:10.497145 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-90e7152b-60ba-4097-b24a-8ecaff4caf61 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:10.497687 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-90e7152b-60ba-4097-b24a-8ecaff4caf61 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:10.498502 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-90e7152b-60ba-4097-b24a-8ecaff4caf61 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:10.501077 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f149d191-245b-452f-801f-8f061021c783 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1279 microversion: 2.1 time: 0.248996 May 23 17:18:10.511487 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 32/69] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:10 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1279 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:10.513226 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-90e7152b-60ba-4097-b24a-8ecaff4caf61 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:10.560785 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=59 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:10.641959 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1894fce2-78d6-4bdb-8610-d0e1b9018068 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:10.642913 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1894fce2-78d6-4bdb-8610-d0e1b9018068 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:10.646271 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=4 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:10.659083 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1894fce2-78d6-4bdb-8610-d0e1b9018068 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:10.659810 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1894fce2-78d6-4bdb-8610-d0e1b9018068 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:10.662580 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1894fce2-78d6-4bdb-8610-d0e1b9018068 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:10.663191 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1894fce2-78d6-4bdb-8610-d0e1b9018068 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:10.962586 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1894fce2-78d6-4bdb-8610-d0e1b9018068 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:10.979257 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1894fce2-78d6-4bdb-8610-d0e1b9018068 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:10.983634 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1894fce2-78d6-4bdb-8610-d0e1b9018068 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:10.985181 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1894fce2-78d6-4bdb-8610-d0e1b9018068 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1339 microversion: 2.20 time: 0.348756 May 23 17:18:10.997578 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 33/70] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:18:10 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1339 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:18:11.070973 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-90e7152b-60ba-4097-b24a-8ecaff4caf61 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0429f5d2715a4487a39281edbd941fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd50da000f94eeca1c4f6ab9867d4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:11.086906 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-90e7152b-60ba-4097-b24a-8ecaff4caf61 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] 10.222.0.46 "GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414" status: 200 len: 1315 microversion: 2.1 time: 0.614774 May 23 17:18:11.098190 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 38/71] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:10 2022] GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414 => generated 1315 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:18:11.521693 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9ebb3bc8-6b9c-4fa6-a516-0d42b534ab6b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:11.522642 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9ebb3bc8-6b9c-4fa6-a516-0d42b534ab6b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:11.535334 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9ebb3bc8-6b9c-4fa6-a516-0d42b534ab6b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:11.535889 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9ebb3bc8-6b9c-4fa6-a516-0d42b534ab6b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:11.537157 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9ebb3bc8-6b9c-4fa6-a516-0d42b534ab6b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:11.537615 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9ebb3bc8-6b9c-4fa6-a516-0d42b534ab6b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:11.956871 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9ebb3bc8-6b9c-4fa6-a516-0d42b534ab6b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:11.985356 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9ebb3bc8-6b9c-4fa6-a516-0d42b534ab6b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1321 microversion: 2.1 time: 0.468451 May 23 17:18:11.996228 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 34/72] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:11 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1321 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:12.007201 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-900725fc-1980-4f59-80b5-551f2ac2c05b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:12.007833 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-900725fc-1980-4f59-80b5-551f2ac2c05b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:12.033302 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-900725fc-1980-4f59-80b5-551f2ac2c05b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:12.035236 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-900725fc-1980-4f59-80b5-551f2ac2c05b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:12.037361 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-900725fc-1980-4f59-80b5-551f2ac2c05b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:12.040143 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-900725fc-1980-4f59-80b5-551f2ac2c05b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:12.106127 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-920bfadc-7e76-4683-b665-171990849cf5 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:12.106943 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-920bfadc-7e76-4683-b665-171990849cf5 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] [instance: 531aeff0-e028-4f24-9d36-a48492b18414] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:12.118456 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-920bfadc-7e76-4683-b665-171990849cf5 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:12.119012 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-920bfadc-7e76-4683-b665-171990849cf5 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:12.120755 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-920bfadc-7e76-4683-b665-171990849cf5 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:12.124959 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-920bfadc-7e76-4683-b665-171990849cf5 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:12.258452 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-900725fc-1980-4f59-80b5-551f2ac2c05b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:12.274875 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-900725fc-1980-4f59-80b5-551f2ac2c05b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:12.286213 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-900725fc-1980-4f59-80b5-551f2ac2c05b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:12.287909 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-900725fc-1980-4f59-80b5-551f2ac2c05b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1339 microversion: 2.20 time: 0.286706 May 23 17:18:12.289508 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 39/73] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:18:12 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1339 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:18:12.557875 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-920bfadc-7e76-4683-b665-171990849cf5 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0429f5d2715a4487a39281edbd941fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd50da000f94eeca1c4f6ab9867d4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:12.575159 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-920bfadc-7e76-4683-b665-171990849cf5 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] 10.222.0.46 "GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414" status: 200 len: 1315 microversion: 2.1 time: 0.473682 May 23 17:18:12.601847 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 35/74] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:12 2022] GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414 => generated 1315 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:12.842431 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-f47dc4ae-7822-4c35-9fa6-f3c07585f923 req-2f83e023-eeb0-488e-a679-61826936c6d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7b61ab9-ad21-427d-a451-1f721fb3a84c", "tag": "29e82388-eff9-4236-8967-3fbfe96b21fa"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:18:12.853560 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-f47dc4ae-7822-4c35-9fa6-f3c07585f923 req-2f83e023-eeb0-488e-a679-61826936c6d0 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:12.854354 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-f47dc4ae-7822-4c35-9fa6-f3c07585f923 req-2f83e023-eeb0-488e-a679-61826936c6d0 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:12.885101 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-f47dc4ae-7822-4c35-9fa6-f3c07585f923 req-2f83e023-eeb0-488e-a679-61826936c6d0 service nova] Creating event network-changed:29e82388-eff9-4236-8967-3fbfe96b21fa for instance e7b61ab9-ad21-427d-a451-1f721fb3a84c on hv-cinder-84299 May 23 17:18:12.890829 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-f47dc4ae-7822-4c35-9fa6-f3c07585f923 req-2f83e023-eeb0-488e-a679-61826936c6d0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.527855 May 23 17:18:12.892537 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 40/75] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 17:18:13.005698 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-57b15cd9-fa64-4ce2-a865-765eb18acb3d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:13.006606 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-57b15cd9-fa64-4ce2-a865-765eb18acb3d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:13.016371 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-57b15cd9-fa64-4ce2-a865-765eb18acb3d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:13.017134 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-57b15cd9-fa64-4ce2-a865-765eb18acb3d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:13.018420 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-57b15cd9-fa64-4ce2-a865-765eb18acb3d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:13.019391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-57b15cd9-fa64-4ce2-a865-765eb18acb3d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:13.095740 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-295c47ef-0b94-4cef-b813-bbb9d7fbc4a2 req-1128693f-6ffd-470d-b7a6-79b223981419 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89495ce8-cbf1-4ac3-b7fa-a83360d167e2", "tag": "fc870750-d842-4e16-9d01-cd2f38ced055"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:18:13.109323 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-295c47ef-0b94-4cef-b813-bbb9d7fbc4a2 req-1128693f-6ffd-470d-b7a6-79b223981419 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:13.109810 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-295c47ef-0b94-4cef-b813-bbb9d7fbc4a2 req-1128693f-6ffd-470d-b7a6-79b223981419 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:13.139413 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-295c47ef-0b94-4cef-b813-bbb9d7fbc4a2 req-1128693f-6ffd-470d-b7a6-79b223981419 service nova] Creating event network-changed:fc870750-d842-4e16-9d01-cd2f38ced055 for instance 89495ce8-cbf1-4ac3-b7fa-a83360d167e2 on hv-cinder-84299 May 23 17:18:13.148340 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-295c47ef-0b94-4cef-b813-bbb9d7fbc4a2 req-1128693f-6ffd-470d-b7a6-79b223981419 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057079 May 23 17:18:13.155410 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 41/76] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 17:18:13.285250 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-57b15cd9-fa64-4ce2-a865-765eb18acb3d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:13.293350 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-57b15cd9-fa64-4ce2-a865-765eb18acb3d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1321 microversion: 2.1 time: 0.293992 May 23 17:18:13.294143 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 36/77] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:12 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1321 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:13.311344 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e66f6660-0215-4ec3-bd07-d529f36cd885 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:13.312494 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-e66f6660-0215-4ec3-bd07-d529f36cd885 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:13.329781 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e66f6660-0215-4ec3-bd07-d529f36cd885 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:13.330240 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e66f6660-0215-4ec3-bd07-d529f36cd885 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:13.332062 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e66f6660-0215-4ec3-bd07-d529f36cd885 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:13.334249 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e66f6660-0215-4ec3-bd07-d529f36cd885 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:13.530271 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e66f6660-0215-4ec3-bd07-d529f36cd885 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:13.540241 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e66f6660-0215-4ec3-bd07-d529f36cd885 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:13.541822 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e66f6660-0215-4ec3-bd07-d529f36cd885 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:13.542937 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-e66f6660-0215-4ec3-bd07-d529f36cd885 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1407 microversion: 2.20 time: 0.236954 May 23 17:18:13.543641 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 42/78] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:18:13 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:18:13.595307 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2bbd14ec-4955-4680-9877-58b22691a213 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:13.595978 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2bbd14ec-4955-4680-9877-58b22691a213 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] [instance: 531aeff0-e028-4f24-9d36-a48492b18414] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:13.602529 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2bbd14ec-4955-4680-9877-58b22691a213 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:13.603264 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2bbd14ec-4955-4680-9877-58b22691a213 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:13.604384 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2bbd14ec-4955-4680-9877-58b22691a213 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:13.605023 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2bbd14ec-4955-4680-9877-58b22691a213 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:13.828478 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2bbd14ec-4955-4680-9877-58b22691a213 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0429f5d2715a4487a39281edbd941fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd50da000f94eeca1c4f6ab9867d4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:13.838088 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2bbd14ec-4955-4680-9877-58b22691a213 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] 10.222.0.46 "GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414" status: 200 len: 1315 microversion: 2.1 time: 0.246957 May 23 17:18:13.839063 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 37/79] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:13 2022] GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:14.310926 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c5409557-add4-4c7a-828a-9b43a23fcb3a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:14.312151 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c5409557-add4-4c7a-828a-9b43a23fcb3a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:14.319036 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c5409557-add4-4c7a-828a-9b43a23fcb3a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:14.319604 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c5409557-add4-4c7a-828a-9b43a23fcb3a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:14.320767 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c5409557-add4-4c7a-828a-9b43a23fcb3a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:14.321111 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c5409557-add4-4c7a-828a-9b43a23fcb3a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:14.469985 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-c5409557-add4-4c7a-828a-9b43a23fcb3a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:14.477809 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c5409557-add4-4c7a-828a-9b43a23fcb3a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1321 microversion: 2.1 time: 0.170764 May 23 17:18:14.487202 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 43/80] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:14 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:14.561070 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2139b586-dee3-419e-a843-2718761fa396 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:14.561683 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2139b586-dee3-419e-a843-2718761fa396 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:14.567671 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2139b586-dee3-419e-a843-2718761fa396 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:14.568099 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2139b586-dee3-419e-a843-2718761fa396 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:14.568876 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2139b586-dee3-419e-a843-2718761fa396 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:14.569310 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2139b586-dee3-419e-a843-2718761fa396 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:14.702545 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2139b586-dee3-419e-a843-2718761fa396 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:14.710981 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2139b586-dee3-419e-a843-2718761fa396 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:14.712738 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2139b586-dee3-419e-a843-2718761fa396 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:14.713840 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2139b586-dee3-419e-a843-2718761fa396 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1407 microversion: 2.20 time: 0.156873 May 23 17:18:14.714400 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 38/81] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:18:14 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:18:14.855222 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-50d1faf2-edd8-45c1-812f-28b0b9cafa12 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:14.856178 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-50d1faf2-edd8-45c1-812f-28b0b9cafa12 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] [instance: 531aeff0-e028-4f24-9d36-a48492b18414] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:14.862999 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-50d1faf2-edd8-45c1-812f-28b0b9cafa12 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:14.863825 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-50d1faf2-edd8-45c1-812f-28b0b9cafa12 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:14.864808 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-50d1faf2-edd8-45c1-812f-28b0b9cafa12 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:14.865419 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-50d1faf2-edd8-45c1-812f-28b0b9cafa12 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:15.281049 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-50d1faf2-edd8-45c1-812f-28b0b9cafa12 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0429f5d2715a4487a39281edbd941fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd50da000f94eeca1c4f6ab9867d4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:15.302299 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-50d1faf2-edd8-45c1-812f-28b0b9cafa12 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] 10.222.0.46 "GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414" status: 200 len: 1315 microversion: 2.1 time: 0.450505 May 23 17:18:15.303266 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 44/82] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:14 2022] GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414 => generated 1315 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:15.494090 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-21d8f52e-5f4f-4972-92d4-86f5268305c9 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:15.494719 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-21d8f52e-5f4f-4972-92d4-86f5268305c9 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:15.518688 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-21d8f52e-5f4f-4972-92d4-86f5268305c9 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:15.519686 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-21d8f52e-5f4f-4972-92d4-86f5268305c9 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:15.520935 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-21d8f52e-5f4f-4972-92d4-86f5268305c9 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:15.527260 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-21d8f52e-5f4f-4972-92d4-86f5268305c9 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:15.725675 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-e2cf2edc-1517-4988-bdb3-b74e89c5ea46 req-e0901247-eda0-4c91-84c1-784258a86526 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4273c3a-0aba-4184-b088-2feaea1b1091", "tag": "0c234a65-eea7-4bdf-ac00-34147e4abec0"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:18:15.760473 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-e2cf2edc-1517-4988-bdb3-b74e89c5ea46 req-e0901247-eda0-4c91-84c1-784258a86526 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:15.761230 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-e2cf2edc-1517-4988-bdb3-b74e89c5ea46 req-e0901247-eda0-4c91-84c1-784258a86526 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:15.795038 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-e2cf2edc-1517-4988-bdb3-b74e89c5ea46 req-e0901247-eda0-4c91-84c1-784258a86526 service nova] Creating event network-changed:0c234a65-eea7-4bdf-ac00-34147e4abec0 for instance f4273c3a-0aba-4184-b088-2feaea1b1091 on hv-cinder-84299 May 23 17:18:15.813364 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-e2cf2edc-1517-4988-bdb3-b74e89c5ea46 req-e0901247-eda0-4c91-84c1-784258a86526 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094500 May 23 17:18:15.815224 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 45/83] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:18:15.821610 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-4f0069ff-2904-49b2-9bdf-6f3f09fd27e1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:15.835861 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-4f0069ff-2904-49b2-9bdf-6f3f09fd27e1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:15.855586 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4f0069ff-2904-49b2-9bdf-6f3f09fd27e1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:15.856048 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4f0069ff-2904-49b2-9bdf-6f3f09fd27e1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:15.857075 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4f0069ff-2904-49b2-9bdf-6f3f09fd27e1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:15.857522 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4f0069ff-2904-49b2-9bdf-6f3f09fd27e1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:15.995707 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-21d8f52e-5f4f-4972-92d4-86f5268305c9 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:16.007310 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-21d8f52e-5f4f-4972-92d4-86f5268305c9 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1321 microversion: 2.1 time: 0.517361 May 23 17:18:16.009515 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 39/84] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:15 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1321 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:16.130325 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-4f0069ff-2904-49b2-9bdf-6f3f09fd27e1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:16.145183 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-4f0069ff-2904-49b2-9bdf-6f3f09fd27e1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:16.146805 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-4f0069ff-2904-49b2-9bdf-6f3f09fd27e1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:16.148072 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-4f0069ff-2904-49b2-9bdf-6f3f09fd27e1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1407 microversion: 2.20 time: 0.331470 May 23 17:18:16.151540 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 46/85] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:18:15 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1407 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:18:16.326496 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-672fbeaf-0fea-4c20-a159-a065f66deae5 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:16.328072 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-672fbeaf-0fea-4c20-a159-a065f66deae5 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] [instance: 531aeff0-e028-4f24-9d36-a48492b18414] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:16.337142 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-672fbeaf-0fea-4c20-a159-a065f66deae5 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:16.337817 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-672fbeaf-0fea-4c20-a159-a065f66deae5 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:16.339312 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-672fbeaf-0fea-4c20-a159-a065f66deae5 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:16.339947 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-672fbeaf-0fea-4c20-a159-a065f66deae5 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:16.544876 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-672fbeaf-0fea-4c20-a159-a065f66deae5 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0429f5d2715a4487a39281edbd941fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd50da000f94eeca1c4f6ab9867d4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:16.553572 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-672fbeaf-0fea-4c20-a159-a065f66deae5 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] 10.222.0.46 "GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414" status: 200 len: 1315 microversion: 2.1 time: 0.236675 May 23 17:18:16.554491 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 40/86] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:16 2022] GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:17.026330 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-03aa5a4a-5355-474b-94a0-54fde335a011 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:17.026892 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-03aa5a4a-5355-474b-94a0-54fde335a011 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:17.033564 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-03aa5a4a-5355-474b-94a0-54fde335a011 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:17.034009 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-03aa5a4a-5355-474b-94a0-54fde335a011 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:17.034767 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-03aa5a4a-5355-474b-94a0-54fde335a011 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:17.035195 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-03aa5a4a-5355-474b-94a0-54fde335a011 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:17.166498 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-81bd1abe-356b-4a7d-a925-5e4675ea98fd tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:17.167183 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-81bd1abe-356b-4a7d-a925-5e4675ea98fd tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:17.177728 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-81bd1abe-356b-4a7d-a925-5e4675ea98fd tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:17.178570 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-81bd1abe-356b-4a7d-a925-5e4675ea98fd tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:17.179591 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-81bd1abe-356b-4a7d-a925-5e4675ea98fd tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:17.180236 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-81bd1abe-356b-4a7d-a925-5e4675ea98fd tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:17.402576 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=6 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:17.414414 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-03aa5a4a-5355-474b-94a0-54fde335a011 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:17.421224 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-81bd1abe-356b-4a7d-a925-5e4675ea98fd tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:17.429419 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-03aa5a4a-5355-474b-94a0-54fde335a011 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1321 microversion: 2.1 time: 0.407178 May 23 17:18:17.430210 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-81bd1abe-356b-4a7d-a925-5e4675ea98fd tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:17.430354 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 47/87] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:17 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1321 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:17.431508 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-81bd1abe-356b-4a7d-a925-5e4675ea98fd tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:17.432689 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-81bd1abe-356b-4a7d-a925-5e4675ea98fd tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1407 microversion: 2.20 time: 0.270347 May 23 17:18:17.433235 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 41/88] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:18:17 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1407 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 17:18:17.570668 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-ce90872b-876d-4ec0-9053-b5d12eab915b tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:17.571297 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-ce90872b-876d-4ec0-9053-b5d12eab915b tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] [instance: 531aeff0-e028-4f24-9d36-a48492b18414] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:17.573214 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=14 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:17.578255 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ce90872b-876d-4ec0-9053-b5d12eab915b tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:17.578712 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ce90872b-876d-4ec0-9053-b5d12eab915b tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:17.579515 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ce90872b-876d-4ec0-9053-b5d12eab915b tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:17.579955 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ce90872b-876d-4ec0-9053-b5d12eab915b tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:17.725090 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ce90872b-876d-4ec0-9053-b5d12eab915b tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0429f5d2715a4487a39281edbd941fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd50da000f94eeca1c4f6ab9867d4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:17.732706 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-ce90872b-876d-4ec0-9053-b5d12eab915b tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] 10.222.0.46 "GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414" status: 200 len: 1315 microversion: 2.1 time: 0.166144 May 23 17:18:17.733290 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 48/89] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:17 2022] GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:18.446457 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7946f9ac-9b20-456c-b640-2b0d4cf05c37 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:18.447004 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7946f9ac-9b20-456c-b640-2b0d4cf05c37 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:18.455157 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-00078ffe-e33a-4c12-bf06-88fa057b6bcc tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:18.455768 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-00078ffe-e33a-4c12-bf06-88fa057b6bcc tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:18.461079 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=2 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:18.464366 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=10 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:18.471230 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-00078ffe-e33a-4c12-bf06-88fa057b6bcc tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:18.474199 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-00078ffe-e33a-4c12-bf06-88fa057b6bcc tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:18.475270 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-00078ffe-e33a-4c12-bf06-88fa057b6bcc tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:18.476414 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-00078ffe-e33a-4c12-bf06-88fa057b6bcc tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:18.487297 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7946f9ac-9b20-456c-b640-2b0d4cf05c37 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:18.487750 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7946f9ac-9b20-456c-b640-2b0d4cf05c37 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:18.488549 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7946f9ac-9b20-456c-b640-2b0d4cf05c37 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:18.489001 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7946f9ac-9b20-456c-b640-2b0d4cf05c37 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:18.879504 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7946f9ac-9b20-456c-b640-2b0d4cf05c37 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:18.892217 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7946f9ac-9b20-456c-b640-2b0d4cf05c37 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1321 microversion: 2.1 time: 0.449490 May 23 17:18:18.902868 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 42/90] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:18 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1321 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:18.983246 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-00078ffe-e33a-4c12-bf06-88fa057b6bcc tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:19.002934 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-00078ffe-e33a-4c12-bf06-88fa057b6bcc tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:19.006994 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-00078ffe-e33a-4c12-bf06-88fa057b6bcc tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:19.010802 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-00078ffe-e33a-4c12-bf06-88fa057b6bcc tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1407 microversion: 2.20 time: 0.559643 May 23 17:18:19.012432 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 49/91] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:18:18 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1407 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:18:19.022562 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d60115d9-d5e7-426d-bcfd-8ed3dc1fdb55 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:19.023554 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d60115d9-d5e7-426d-bcfd-8ed3dc1fdb55 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] [instance: 531aeff0-e028-4f24-9d36-a48492b18414] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:19.037275 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d60115d9-d5e7-426d-bcfd-8ed3dc1fdb55 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:19.038860 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d60115d9-d5e7-426d-bcfd-8ed3dc1fdb55 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:19.040995 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d60115d9-d5e7-426d-bcfd-8ed3dc1fdb55 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:19.042202 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d60115d9-d5e7-426d-bcfd-8ed3dc1fdb55 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:19.057169 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-df21255f-dc05-45d5-a825-877a4413da61 req-4522320c-9849-4600-986b-ed41cd1647a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "531aeff0-e028-4f24-9d36-a48492b18414", "name": "network-vif-plugged", "status": "completed", "tag": "5629b784-503a-468a-9ee8-3b6e4a0d377d"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:18:19.071685 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-df21255f-dc05-45d5-a825-877a4413da61 req-4522320c-9849-4600-986b-ed41cd1647a5 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:19.072425 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-df21255f-dc05-45d5-a825-877a4413da61 req-4522320c-9849-4600-986b-ed41cd1647a5 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:19.098192 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-df21255f-dc05-45d5-a825-877a4413da61 req-4522320c-9849-4600-986b-ed41cd1647a5 service nova] Creating event network-vif-plugged:5629b784-503a-468a-9ee8-3b6e4a0d377d for instance 531aeff0-e028-4f24-9d36-a48492b18414 on hv-cinder-84299 May 23 17:18:19.098737 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-df21255f-dc05-45d5-a825-877a4413da61 req-4522320c-9849-4600-986b-ed41cd1647a5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117909) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 23 17:18:19.100091 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c6ab4d0e-04af-463c-bb54-aaaaf16c29f6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:19.100547 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c6ab4d0e-04af-463c-bb54-aaaaf16c29f6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:19.101341 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c6ab4d0e-04af-463c-bb54-aaaaf16c29f6 None None] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:19.101938 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c6ab4d0e-04af-463c-bb54-aaaaf16c29f6 None None] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:19.111111 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.compute.rpcapi [None req-c6ab4d0e-04af-463c-bb54-aaaaf16c29f6 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 23 17:18:19.111975 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c6ab4d0e-04af-463c-bb54-aaaaf16c29f6 None None] Releasing lock "compute-rpcapi-router" {{(pid=117909) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 23 17:18:19.130349 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c6ab4d0e-04af-463c-bb54-aaaaf16c29f6 None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.225363 May 23 17:18:19.131237 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 43/92] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:18:19.415212 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d60115d9-d5e7-426d-bcfd-8ed3dc1fdb55 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0429f5d2715a4487a39281edbd941fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd50da000f94eeca1c4f6ab9867d4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:19.441341 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d60115d9-d5e7-426d-bcfd-8ed3dc1fdb55 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] 10.222.0.46 "GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414" status: 200 len: 1315 microversion: 2.1 time: 0.427046 May 23 17:18:19.441933 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 50/93] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:19 2022] GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414 => generated 1315 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:19.912254 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d480a564-8823-43d6-9466-07961a5f1aec tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:19.912801 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d480a564-8823-43d6-9466-07961a5f1aec tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:19.926877 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d480a564-8823-43d6-9466-07961a5f1aec tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:19.927331 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d480a564-8823-43d6-9466-07961a5f1aec tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:19.928110 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d480a564-8823-43d6-9466-07961a5f1aec tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:19.928539 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d480a564-8823-43d6-9466-07961a5f1aec tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:20.030941 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2cc864e3-8358-4462-9dd9-7bd0e5e34857 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:20.032268 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2cc864e3-8358-4462-9dd9-7bd0e5e34857 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:20.044902 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2cc864e3-8358-4462-9dd9-7bd0e5e34857 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:20.050048 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2cc864e3-8358-4462-9dd9-7bd0e5e34857 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:20.054510 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2cc864e3-8358-4462-9dd9-7bd0e5e34857 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:20.055301 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2cc864e3-8358-4462-9dd9-7bd0e5e34857 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:20.172347 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d480a564-8823-43d6-9466-07961a5f1aec tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:20.186341 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d480a564-8823-43d6-9466-07961a5f1aec tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1321 microversion: 2.1 time: 0.278243 May 23 17:18:20.189774 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 44/94] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:19 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1321 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:20.334356 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2cc864e3-8358-4462-9dd9-7bd0e5e34857 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:20.349986 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2cc864e3-8358-4462-9dd9-7bd0e5e34857 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:20.353619 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2cc864e3-8358-4462-9dd9-7bd0e5e34857 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:20.354966 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2cc864e3-8358-4462-9dd9-7bd0e5e34857 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1407 microversion: 2.20 time: 0.328575 May 23 17:18:20.359588 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 51/95] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:18:20 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1407 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 17:18:20.461615 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-90443274-cf40-4879-b300-cfa485e55bb6 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:20.462587 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-90443274-cf40-4879-b300-cfa485e55bb6 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] [instance: 531aeff0-e028-4f24-9d36-a48492b18414] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:20.480557 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-90443274-cf40-4879-b300-cfa485e55bb6 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:20.481675 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-90443274-cf40-4879-b300-cfa485e55bb6 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:20.482753 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-90443274-cf40-4879-b300-cfa485e55bb6 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:20.483327 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-90443274-cf40-4879-b300-cfa485e55bb6 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:20.674940 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-90443274-cf40-4879-b300-cfa485e55bb6 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0429f5d2715a4487a39281edbd941fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd50da000f94eeca1c4f6ab9867d4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:20.683360 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-90443274-cf40-4879-b300-cfa485e55bb6 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] 10.222.0.46 "GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414" status: 200 len: 1315 microversion: 2.1 time: 0.229483 May 23 17:18:20.683883 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 45/96] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:20 2022] GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:21.204917 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-083eafb4-8b6d-4959-9118-62464124c3c1 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:21.206361 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-083eafb4-8b6d-4959-9118-62464124c3c1 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:21.214814 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-083eafb4-8b6d-4959-9118-62464124c3c1 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:21.215940 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-083eafb4-8b6d-4959-9118-62464124c3c1 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:21.221255 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-083eafb4-8b6d-4959-9118-62464124c3c1 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:21.221718 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-083eafb4-8b6d-4959-9118-62464124c3c1 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:21.378559 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3a7d0e5e-6717-4ce2-aecc-9099575c3785 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:21.379396 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3a7d0e5e-6717-4ce2-aecc-9099575c3785 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:21.390991 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3a7d0e5e-6717-4ce2-aecc-9099575c3785 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:21.396004 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3a7d0e5e-6717-4ce2-aecc-9099575c3785 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:21.396844 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3a7d0e5e-6717-4ce2-aecc-9099575c3785 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:21.397289 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3a7d0e5e-6717-4ce2-aecc-9099575c3785 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:21.435651 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-083eafb4-8b6d-4959-9118-62464124c3c1 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:21.452805 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-083eafb4-8b6d-4959-9118-62464124c3c1 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1321 microversion: 2.1 time: 0.253075 May 23 17:18:21.455200 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 52/97] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:21 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1321 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:18:21.634169 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3a7d0e5e-6717-4ce2-aecc-9099575c3785 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:21.649572 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3a7d0e5e-6717-4ce2-aecc-9099575c3785 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:21.656166 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3a7d0e5e-6717-4ce2-aecc-9099575c3785 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:21.661158 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3a7d0e5e-6717-4ce2-aecc-9099575c3785 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1407 microversion: 2.20 time: 0.287405 May 23 17:18:21.663466 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 46/98] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:18:21 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1407 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:18:21.704485 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-cb5b1c49-c210-4e94-8777-98a6605796db tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:21.705447 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-cb5b1c49-c210-4e94-8777-98a6605796db tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] [instance: 531aeff0-e028-4f24-9d36-a48492b18414] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:21.714402 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cb5b1c49-c210-4e94-8777-98a6605796db tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:21.717111 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cb5b1c49-c210-4e94-8777-98a6605796db tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:21.718817 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cb5b1c49-c210-4e94-8777-98a6605796db tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:21.725550 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cb5b1c49-c210-4e94-8777-98a6605796db tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:21.892928 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-16a5be8c-259d-40eb-94a7-f372f333ab3b req-c5635504-e924-4441-b3fd-7135d840d435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7b61ab9-ad21-427d-a451-1f721fb3a84c", "name": "network-vif-plugged", "status": "completed", "tag": "29e82388-eff9-4236-8967-3fbfe96b21fa"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:18:21.911332 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-16a5be8c-259d-40eb-94a7-f372f333ab3b req-c5635504-e924-4441-b3fd-7135d840d435 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:21.916190 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-16a5be8c-259d-40eb-94a7-f372f333ab3b req-c5635504-e924-4441-b3fd-7135d840d435 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:21.926191 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-cb5b1c49-c210-4e94-8777-98a6605796db tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0429f5d2715a4487a39281edbd941fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd50da000f94eeca1c4f6ab9867d4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:21.952482 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-cb5b1c49-c210-4e94-8777-98a6605796db tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] 10.222.0.46 "GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414" status: 200 len: 1315 microversion: 2.1 time: 0.249258 May 23 17:18:21.953390 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 53/99] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:21 2022] GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:21.961055 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-16a5be8c-259d-40eb-94a7-f372f333ab3b req-c5635504-e924-4441-b3fd-7135d840d435 service nova] Creating event network-vif-plugged:29e82388-eff9-4236-8967-3fbfe96b21fa for instance e7b61ab9-ad21-427d-a451-1f721fb3a84c on hv-cinder-84299 May 23 17:18:21.977433 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-16a5be8c-259d-40eb-94a7-f372f333ab3b req-c5635504-e924-4441-b3fd-7135d840d435 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089396 May 23 17:18:21.981861 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 47/100] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:18:22.476247 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-9966387c-e411-4708-8e78-d1bcb63f3ebd tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:22.477512 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-9966387c-e411-4708-8e78-d1bcb63f3ebd tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:22.488689 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9966387c-e411-4708-8e78-d1bcb63f3ebd tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:22.494222 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9966387c-e411-4708-8e78-d1bcb63f3ebd tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:22.495878 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9966387c-e411-4708-8e78-d1bcb63f3ebd tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:22.496478 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9966387c-e411-4708-8e78-d1bcb63f3ebd tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:22.667745 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9966387c-e411-4708-8e78-d1bcb63f3ebd tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:22.682663 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-303ce3f3-3090-4605-a746-2a27f6d7e257 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:22.683393 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-303ce3f3-3090-4605-a746-2a27f6d7e257 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:22.688269 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-9966387c-e411-4708-8e78-d1bcb63f3ebd tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1321 microversion: 2.1 time: 0.216856 May 23 17:18:22.690535 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 54/101] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:22 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1321 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:22.693202 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-303ce3f3-3090-4605-a746-2a27f6d7e257 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:22.693759 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-303ce3f3-3090-4605-a746-2a27f6d7e257 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:22.694620 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-303ce3f3-3090-4605-a746-2a27f6d7e257 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:22.695133 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-303ce3f3-3090-4605-a746-2a27f6d7e257 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:22.871717 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-303ce3f3-3090-4605-a746-2a27f6d7e257 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:22.884550 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-303ce3f3-3090-4605-a746-2a27f6d7e257 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:22.886672 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-303ce3f3-3090-4605-a746-2a27f6d7e257 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:22.887849 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-303ce3f3-3090-4605-a746-2a27f6d7e257 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1407 microversion: 2.20 time: 0.210560 May 23 17:18:22.889613 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 48/102] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:18:22 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 17:18:22.970742 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-ffd8c8d6-503d-4434-9530-3263d2a5cea0 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:22.971613 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-ffd8c8d6-503d-4434-9530-3263d2a5cea0 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] [instance: 531aeff0-e028-4f24-9d36-a48492b18414] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:22.977840 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ffd8c8d6-503d-4434-9530-3263d2a5cea0 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:22.978507 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ffd8c8d6-503d-4434-9530-3263d2a5cea0 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:22.979281 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ffd8c8d6-503d-4434-9530-3263d2a5cea0 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:22.979716 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ffd8c8d6-503d-4434-9530-3263d2a5cea0 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:23.209468 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ffd8c8d6-503d-4434-9530-3263d2a5cea0 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0429f5d2715a4487a39281edbd941fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd50da000f94eeca1c4f6ab9867d4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:23.218623 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-ffd8c8d6-503d-4434-9530-3263d2a5cea0 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] 10.222.0.46 "GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414" status: 200 len: 1503 microversion: 2.1 time: 0.251664 May 23 17:18:23.220028 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 55/103] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:22 2022] GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414 => generated 1503 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:23.707500 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b0a28893-ee00-433e-8cfc-b41731165029 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:23.708250 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b0a28893-ee00-433e-8cfc-b41731165029 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:23.716878 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b0a28893-ee00-433e-8cfc-b41731165029 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:23.716878 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b0a28893-ee00-433e-8cfc-b41731165029 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:23.721653 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b0a28893-ee00-433e-8cfc-b41731165029 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:23.722172 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b0a28893-ee00-433e-8cfc-b41731165029 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:23.908162 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-08510d7c-51ea-4daa-8aa2-5d3f852b2379 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:23.908925 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-08510d7c-51ea-4daa-8aa2-5d3f852b2379 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:23.924940 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-08510d7c-51ea-4daa-8aa2-5d3f852b2379 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:23.925429 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-08510d7c-51ea-4daa-8aa2-5d3f852b2379 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:23.926493 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-08510d7c-51ea-4daa-8aa2-5d3f852b2379 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:23.927457 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-08510d7c-51ea-4daa-8aa2-5d3f852b2379 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:24.006676 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b0a28893-ee00-433e-8cfc-b41731165029 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:24.026437 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b0a28893-ee00-433e-8cfc-b41731165029 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1321 microversion: 2.1 time: 0.320381 May 23 17:18:24.028950 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 49/104] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:23 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1321 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:24.041606 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-0e257d28-f5cd-433d-b4c0-1f15821de7fd req-7afbf9dd-a9e3-4ca7-865b-c39e7099fe04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89495ce8-cbf1-4ac3-b7fa-a83360d167e2", "name": "network-vif-plugged", "status": "completed", "tag": "fc870750-d842-4e16-9d01-cd2f38ced055"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:18:24.073569 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-0e257d28-f5cd-433d-b4c0-1f15821de7fd req-7afbf9dd-a9e3-4ca7-865b-c39e7099fe04 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:24.074208 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-0e257d28-f5cd-433d-b4c0-1f15821de7fd req-7afbf9dd-a9e3-4ca7-865b-c39e7099fe04 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:24.117502 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-0e257d28-f5cd-433d-b4c0-1f15821de7fd req-7afbf9dd-a9e3-4ca7-865b-c39e7099fe04 service nova] Creating event network-vif-plugged:fc870750-d842-4e16-9d01-cd2f38ced055 for instance 89495ce8-cbf1-4ac3-b7fa-a83360d167e2 on hv-cinder-84299 May 23 17:18:24.137329 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-0e257d28-f5cd-433d-b4c0-1f15821de7fd req-7afbf9dd-a9e3-4ca7-865b-c39e7099fe04 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105411 May 23 17:18:24.141691 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 50/105] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:18:24.334341 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-08510d7c-51ea-4daa-8aa2-5d3f852b2379 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:24.337092 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=100 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:24.350794 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-08510d7c-51ea-4daa-8aa2-5d3f852b2379 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:24.352724 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-08510d7c-51ea-4daa-8aa2-5d3f852b2379 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:24.360252 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-08510d7c-51ea-4daa-8aa2-5d3f852b2379 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1407 microversion: 2.20 time: 0.454926 May 23 17:18:24.361394 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 56/106] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:18:23 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1407 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:18:25.047592 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a55557a6-7877-4d3f-b508-a928a62f2845 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:25.048436 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a55557a6-7877-4d3f-b508-a928a62f2845 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:25.061310 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a55557a6-7877-4d3f-b508-a928a62f2845 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:25.061841 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a55557a6-7877-4d3f-b508-a928a62f2845 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:25.064151 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a55557a6-7877-4d3f-b508-a928a62f2845 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:25.065215 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a55557a6-7877-4d3f-b508-a928a62f2845 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:25.083984 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:25.234004 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a55557a6-7877-4d3f-b508-a928a62f2845 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:25.243166 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a55557a6-7877-4d3f-b508-a928a62f2845 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1321 microversion: 2.1 time: 0.200392 May 23 17:18:25.243740 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 51/107] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:25 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:25.321364 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c5fc44dc-b99c-4ab7-9fef-f454d8b1ccb5 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "616227a4-be34-4942-b2eb-cd89ef5c444b"}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:18:25.323219 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c5fc44dc-b99c-4ab7-9fef-f454d8b1ccb5 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] [instance: 531aeff0-e028-4f24-9d36-a48492b18414] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:25.332931 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c5fc44dc-b99c-4ab7-9fef-f454d8b1ccb5 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:25.333824 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c5fc44dc-b99c-4ab7-9fef-f454d8b1ccb5 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:25.335441 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c5fc44dc-b99c-4ab7-9fef-f454d8b1ccb5 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:25.336476 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c5fc44dc-b99c-4ab7-9fef-f454d8b1ccb5 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:25.380366 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8244245d-e654-4efe-a5a0-ee4089d68e14 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:25.381572 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8244245d-e654-4efe-a5a0-ee4089d68e14 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:25.394212 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8244245d-e654-4efe-a5a0-ee4089d68e14 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:25.394907 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8244245d-e654-4efe-a5a0-ee4089d68e14 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:25.399931 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8244245d-e654-4efe-a5a0-ee4089d68e14 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:25.400497 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8244245d-e654-4efe-a5a0-ee4089d68e14 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:25.758746 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8244245d-e654-4efe-a5a0-ee4089d68e14 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:25.771463 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8244245d-e654-4efe-a5a0-ee4089d68e14 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:25.774615 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8244245d-e654-4efe-a5a0-ee4089d68e14 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:25.776322 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8244245d-e654-4efe-a5a0-ee4089d68e14 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1407 microversion: 2.20 time: 0.400234 May 23 17:18:25.777711 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 52/108] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:18:25 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1407 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 17:18:26.120758 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c5fc44dc-b99c-4ab7-9fef-f454d8b1ccb5 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] 10.222.0.46 "POST /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.803900 May 23 17:18:26.121454 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 57/109] 10.222.0.46 () {60 vars in 1322 bytes} [Mon May 23 17:18:25 2022] POST /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414/os-volume_attachments => generated 194 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:18:26.219297 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-a26d0874-1880-488f-bcaa-453ff2774ad2 req-bf64571d-e4c7-4517-961d-104a7f856844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4273c3a-0aba-4184-b088-2feaea1b1091", "name": "network-vif-plugged", "status": "completed", "tag": "0c234a65-eea7-4bdf-ac00-34147e4abec0"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:18:26.228104 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-a26d0874-1880-488f-bcaa-453ff2774ad2 req-bf64571d-e4c7-4517-961d-104a7f856844 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:26.228545 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-a26d0874-1880-488f-bcaa-453ff2774ad2 req-bf64571d-e4c7-4517-961d-104a7f856844 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:26.239599 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-a26d0874-1880-488f-bcaa-453ff2774ad2 req-bf64571d-e4c7-4517-961d-104a7f856844 service nova] Creating event network-vif-plugged:0c234a65-eea7-4bdf-ac00-34147e4abec0 for instance f4273c3a-0aba-4184-b088-2feaea1b1091 on hv-cinder-84299 May 23 17:18:26.245492 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-a26d0874-1880-488f-bcaa-453ff2774ad2 req-bf64571d-e4c7-4517-961d-104a7f856844 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029872 May 23 17:18:26.246453 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 53/110] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:18:26.260842 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-1c53ce8b-2200-449b-b411-f2d8701b2f79 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:26.261753 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-1c53ce8b-2200-449b-b411-f2d8701b2f79 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:26.269371 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1c53ce8b-2200-449b-b411-f2d8701b2f79 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:26.269818 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1c53ce8b-2200-449b-b411-f2d8701b2f79 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:26.270581 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1c53ce8b-2200-449b-b411-f2d8701b2f79 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:26.271018 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1c53ce8b-2200-449b-b411-f2d8701b2f79 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:26.413079 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-1c53ce8b-2200-449b-b411-f2d8701b2f79 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:26.420942 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-1c53ce8b-2200-449b-b411-f2d8701b2f79 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1321 microversion: 2.1 time: 0.164482 May 23 17:18:26.430354 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 58/111] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:26 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:26.797687 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-414d9f93-4427-4b91-ba98-23e0ebe998ac tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:26.798386 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-414d9f93-4427-4b91-ba98-23e0ebe998ac tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:26.808948 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-414d9f93-4427-4b91-ba98-23e0ebe998ac tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:26.809482 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-414d9f93-4427-4b91-ba98-23e0ebe998ac tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:26.810172 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-414d9f93-4427-4b91-ba98-23e0ebe998ac tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:26.810598 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-414d9f93-4427-4b91-ba98-23e0ebe998ac tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:27.014336 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-414d9f93-4427-4b91-ba98-23e0ebe998ac tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:27.024862 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-414d9f93-4427-4b91-ba98-23e0ebe998ac tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:27.026661 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-414d9f93-4427-4b91-ba98-23e0ebe998ac tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:27.027789 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-414d9f93-4427-4b91-ba98-23e0ebe998ac tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1407 microversion: 2.20 time: 0.234983 May 23 17:18:27.038727 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 54/112] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:18:26 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:18:27.437633 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-ec07df56-d81a-47f4-ac14-f9183f8fcb5e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:27.439474 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-ec07df56-d81a-47f4-ac14-f9183f8fcb5e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:27.447796 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ec07df56-d81a-47f4-ac14-f9183f8fcb5e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:27.448665 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ec07df56-d81a-47f4-ac14-f9183f8fcb5e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:27.449967 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ec07df56-d81a-47f4-ac14-f9183f8fcb5e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:27.450408 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ec07df56-d81a-47f4-ac14-f9183f8fcb5e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:27.689455 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ec07df56-d81a-47f4-ac14-f9183f8fcb5e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:27.699193 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-ec07df56-d81a-47f4-ac14-f9183f8fcb5e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1516 microversion: 2.1 time: 0.264406 May 23 17:18:27.700556 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 59/113] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:27 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1516 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:27.729145 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-32843326-9014-4226-ad89-167535efd5a5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:18:27.732414 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-32843326-9014-4226-ad89-167535efd5a5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:27.738464 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-32843326-9014-4226-ad89-167535efd5a5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:27.739049 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-32843326-9014-4226-ad89-167535efd5a5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:27.740041 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-32843326-9014-4226-ad89-167535efd5a5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:27.740940 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-32843326-9014-4226-ad89-167535efd5a5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:27.832558 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.objects.instance [None req-32843326-9014-4226-ad89-167535efd5a5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lazy-loading 'flavor' on Instance uuid 89495ce8-cbf1-4ac3-b7fa-a83360d167e2 {{(pid=117909) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 17:18:27.982154 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-32843326-9014-4226-ad89-167535efd5a5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "POST /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2/action" status: 200 len: 32 microversion: 2.1 time: 0.266243 May 23 17:18:27.982510 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 55/114] 10.222.0.46 () {60 vars in 1277 bytes} [Mon May 23 17:18:27 2022] POST /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2/action => generated 32 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 17:18:27.992244 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-63da6d8d-9371-4c31-9e1d-b217b83d0abf tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:27.993379 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-63da6d8d-9371-4c31-9e1d-b217b83d0abf tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:27.999972 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-63da6d8d-9371-4c31-9e1d-b217b83d0abf tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:28.000530 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-63da6d8d-9371-4c31-9e1d-b217b83d0abf tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:28.001479 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-63da6d8d-9371-4c31-9e1d-b217b83d0abf tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:28.002060 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-63da6d8d-9371-4c31-9e1d-b217b83d0abf tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:28.049643 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f84e8d31-6add-4844-8e5c-5026d7c0c7d8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:28.050357 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f84e8d31-6add-4844-8e5c-5026d7c0c7d8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:28.072809 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f84e8d31-6add-4844-8e5c-5026d7c0c7d8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:28.073500 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f84e8d31-6add-4844-8e5c-5026d7c0c7d8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:28.085762 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f84e8d31-6add-4844-8e5c-5026d7c0c7d8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:28.088740 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f84e8d31-6add-4844-8e5c-5026d7c0c7d8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:28.270515 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-63da6d8d-9371-4c31-9e1d-b217b83d0abf tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:28.279893 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-63da6d8d-9371-4c31-9e1d-b217b83d0abf tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1522 microversion: 2.1 time: 0.291537 May 23 17:18:28.280902 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 60/115] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:27 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:28.330958 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f84e8d31-6add-4844-8e5c-5026d7c0c7d8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:28.342265 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f84e8d31-6add-4844-8e5c-5026d7c0c7d8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:28.344615 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f84e8d31-6add-4844-8e5c-5026d7c0c7d8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:28.345995 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f84e8d31-6add-4844-8e5c-5026d7c0c7d8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1407 microversion: 2.20 time: 0.304836 May 23 17:18:28.356969 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 56/116] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:18:28 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1407 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:18:29.297603 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-1a903867-16dc-49fa-8ddb-51d4c681fc9d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:29.298215 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-1a903867-16dc-49fa-8ddb-51d4c681fc9d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:29.306619 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1a903867-16dc-49fa-8ddb-51d4c681fc9d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:29.307070 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1a903867-16dc-49fa-8ddb-51d4c681fc9d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:29.307843 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1a903867-16dc-49fa-8ddb-51d4c681fc9d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:29.308277 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1a903867-16dc-49fa-8ddb-51d4c681fc9d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:29.364506 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-449dc37c-92a4-4fa0-84fc-5b7aad76a3ff tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:29.365158 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-449dc37c-92a4-4fa0-84fc-5b7aad76a3ff tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:29.367313 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=2 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:29.395495 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-449dc37c-92a4-4fa0-84fc-5b7aad76a3ff tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:29.395979 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-449dc37c-92a4-4fa0-84fc-5b7aad76a3ff tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:29.396871 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-449dc37c-92a4-4fa0-84fc-5b7aad76a3ff tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:29.397369 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-449dc37c-92a4-4fa0-84fc-5b7aad76a3ff tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:29.502717 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-1a903867-16dc-49fa-8ddb-51d4c681fc9d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:29.515946 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-1a903867-16dc-49fa-8ddb-51d4c681fc9d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1522 microversion: 2.1 time: 0.222151 May 23 17:18:29.517399 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 61/117] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:29 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:29.835142 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-449dc37c-92a4-4fa0-84fc-5b7aad76a3ff tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:29.856412 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-449dc37c-92a4-4fa0-84fc-5b7aad76a3ff tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:29.858635 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-449dc37c-92a4-4fa0-84fc-5b7aad76a3ff tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:29.860510 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-449dc37c-92a4-4fa0-84fc-5b7aad76a3ff tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1599 microversion: 2.20 time: 0.499927 May 23 17:18:29.861284 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 57/118] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:18:29 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1599 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 17:18:29.892123 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c6e65467-9108-41cd-af8a-0dc16f45c93d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:29.892851 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c6e65467-9108-41cd-af8a-0dc16f45c93d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:29.900560 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c6e65467-9108-41cd-af8a-0dc16f45c93d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:29.901287 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c6e65467-9108-41cd-af8a-0dc16f45c93d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:29.902171 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c6e65467-9108-41cd-af8a-0dc16f45c93d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:29.902632 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c6e65467-9108-41cd-af8a-0dc16f45c93d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:30.004298 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c6e65467-9108-41cd-af8a-0dc16f45c93d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.121815 May 23 17:18:30.005149 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 62/119] 10.222.0.46 () {60 vars in 1315 bytes} [Mon May 23 17:18:29 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091/os-interface => generated 285 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 17:18:30.534522 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e5b2d6c0-e33a-4b3a-ba85-b065f2d0fbae tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:30.535232 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e5b2d6c0-e33a-4b3a-ba85-b065f2d0fbae tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:30.547719 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e5b2d6c0-e33a-4b3a-ba85-b065f2d0fbae tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:30.548239 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e5b2d6c0-e33a-4b3a-ba85-b065f2d0fbae tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:30.549205 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e5b2d6c0-e33a-4b3a-ba85-b065f2d0fbae tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:30.549811 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e5b2d6c0-e33a-4b3a-ba85-b065f2d0fbae tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:30.974656 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e5b2d6c0-e33a-4b3a-ba85-b065f2d0fbae tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:30.985610 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e5b2d6c0-e33a-4b3a-ba85-b065f2d0fbae tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1522 microversion: 2.1 time: 0.456026 May 23 17:18:30.986494 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 58/120] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:30 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1522 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:31.669719 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-fccac098-2fed-40cc-a181-a970839cb0bb req-86e79766-a428-46b8-bde7-9c7f62ee8b53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4273c3a-0aba-4184-b088-2feaea1b1091", "tag": "0c234a65-eea7-4bdf-ac00-34147e4abec0"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:18:31.685670 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-fccac098-2fed-40cc-a181-a970839cb0bb req-86e79766-a428-46b8-bde7-9c7f62ee8b53 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:31.686165 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-fccac098-2fed-40cc-a181-a970839cb0bb req-86e79766-a428-46b8-bde7-9c7f62ee8b53 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:31.703183 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-fccac098-2fed-40cc-a181-a970839cb0bb req-86e79766-a428-46b8-bde7-9c7f62ee8b53 service nova] Creating event network-changed:0c234a65-eea7-4bdf-ac00-34147e4abec0 for instance f4273c3a-0aba-4184-b088-2feaea1b1091 on hv-cinder-84299 May 23 17:18:31.708920 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-fccac098-2fed-40cc-a181-a970839cb0bb req-86e79766-a428-46b8-bde7-9c7f62ee8b53 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043942 May 23 17:18:31.712639 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 63/121] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:18:32.003420 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-78a7f046-e8d7-4a83-b90d-380b6734b272 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:32.004064 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-78a7f046-e8d7-4a83-b90d-380b6734b272 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:32.009970 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-78a7f046-e8d7-4a83-b90d-380b6734b272 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:32.010419 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-78a7f046-e8d7-4a83-b90d-380b6734b272 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:32.011914 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-78a7f046-e8d7-4a83-b90d-380b6734b272 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:32.012243 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-78a7f046-e8d7-4a83-b90d-380b6734b272 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:32.546706 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-78a7f046-e8d7-4a83-b90d-380b6734b272 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:32.555246 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-78a7f046-e8d7-4a83-b90d-380b6734b272 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1522 microversion: 2.1 time: 0.555670 May 23 17:18:32.555817 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 59/122] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:31 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1522 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:33.577874 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d13d1df2-8a2c-4682-9338-40bb84285aca tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:33.578951 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d13d1df2-8a2c-4682-9338-40bb84285aca tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:33.589594 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d13d1df2-8a2c-4682-9338-40bb84285aca tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:33.590343 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d13d1df2-8a2c-4682-9338-40bb84285aca tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:33.591599 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d13d1df2-8a2c-4682-9338-40bb84285aca tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:33.592298 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d13d1df2-8a2c-4682-9338-40bb84285aca tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:33.739537 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d13d1df2-8a2c-4682-9338-40bb84285aca tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:33.750532 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d13d1df2-8a2c-4682-9338-40bb84285aca tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1522 microversion: 2.1 time: 0.180620 May 23 17:18:33.751107 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 64/123] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:33 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:34.767384 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e7c59d6b-6da6-4cd7-b015-89f76e9ba588 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:34.768004 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e7c59d6b-6da6-4cd7-b015-89f76e9ba588 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:34.774937 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e7c59d6b-6da6-4cd7-b015-89f76e9ba588 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:34.775395 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e7c59d6b-6da6-4cd7-b015-89f76e9ba588 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:34.776406 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e7c59d6b-6da6-4cd7-b015-89f76e9ba588 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:34.776883 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e7c59d6b-6da6-4cd7-b015-89f76e9ba588 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:34.912193 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e7c59d6b-6da6-4cd7-b015-89f76e9ba588 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:34.921195 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e7c59d6b-6da6-4cd7-b015-89f76e9ba588 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1522 microversion: 2.1 time: 0.157879 May 23 17:18:34.922031 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 60/124] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:34 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:35.938867 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-5125f761-3e77-4226-ad46-57c87fd4ccfe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:35.939420 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-5125f761-3e77-4226-ad46-57c87fd4ccfe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:35.945860 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5125f761-3e77-4226-ad46-57c87fd4ccfe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:35.946302 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5125f761-3e77-4226-ad46-57c87fd4ccfe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:35.947058 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5125f761-3e77-4226-ad46-57c87fd4ccfe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:35.947484 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5125f761-3e77-4226-ad46-57c87fd4ccfe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:36.133798 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-5125f761-3e77-4226-ad46-57c87fd4ccfe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:36.141676 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-5125f761-3e77-4226-ad46-57c87fd4ccfe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1522 microversion: 2.1 time: 0.207042 May 23 17:18:36.142439 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 65/125] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:35 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:37.158322 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-001f05c6-6e4e-4166-b345-99339f4d1598 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:37.158931 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-001f05c6-6e4e-4166-b345-99339f4d1598 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:37.165868 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-001f05c6-6e4e-4166-b345-99339f4d1598 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:37.166525 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-001f05c6-6e4e-4166-b345-99339f4d1598 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:37.168172 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-001f05c6-6e4e-4166-b345-99339f4d1598 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:37.168890 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-001f05c6-6e4e-4166-b345-99339f4d1598 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:37.302450 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-001f05c6-6e4e-4166-b345-99339f4d1598 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:37.310088 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-001f05c6-6e4e-4166-b345-99339f4d1598 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1522 microversion: 2.1 time: 0.155772 May 23 17:18:37.310703 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 61/126] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:37 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:38.326090 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-1ce12483-46a0-49e8-afc9-7aa62f7e6f42 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:38.326753 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-1ce12483-46a0-49e8-afc9-7aa62f7e6f42 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:38.333771 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1ce12483-46a0-49e8-afc9-7aa62f7e6f42 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:38.334228 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1ce12483-46a0-49e8-afc9-7aa62f7e6f42 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:38.335002 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1ce12483-46a0-49e8-afc9-7aa62f7e6f42 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:38.335438 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1ce12483-46a0-49e8-afc9-7aa62f7e6f42 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:38.467953 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-1ce12483-46a0-49e8-afc9-7aa62f7e6f42 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:38.475381 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-1ce12483-46a0-49e8-afc9-7aa62f7e6f42 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1522 microversion: 2.1 time: 0.153189 May 23 17:18:38.475951 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 66/127] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:38 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:39.492958 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-81e6d7b4-56a1-4c23-9bbc-8d5f0e14043e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:39.493627 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-81e6d7b4-56a1-4c23-9bbc-8d5f0e14043e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:39.501357 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-81e6d7b4-56a1-4c23-9bbc-8d5f0e14043e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:39.501866 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-81e6d7b4-56a1-4c23-9bbc-8d5f0e14043e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:39.502668 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-81e6d7b4-56a1-4c23-9bbc-8d5f0e14043e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:39.503133 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-81e6d7b4-56a1-4c23-9bbc-8d5f0e14043e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:39.637474 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-81e6d7b4-56a1-4c23-9bbc-8d5f0e14043e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:39.646307 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-81e6d7b4-56a1-4c23-9bbc-8d5f0e14043e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1522 microversion: 2.1 time: 0.157727 May 23 17:18:39.646939 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 62/128] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:39 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:40.663300 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d452013f-75c8-4768-ae0c-5dcfde197abf tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:40.664059 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d452013f-75c8-4768-ae0c-5dcfde197abf tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:40.666575 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=58 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:40.672201 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d452013f-75c8-4768-ae0c-5dcfde197abf tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:40.672694 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d452013f-75c8-4768-ae0c-5dcfde197abf tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:40.673455 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d452013f-75c8-4768-ae0c-5dcfde197abf tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:40.673890 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d452013f-75c8-4768-ae0c-5dcfde197abf tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:40.814677 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d452013f-75c8-4768-ae0c-5dcfde197abf tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:40.822113 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d452013f-75c8-4768-ae0c-5dcfde197abf tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1522 microversion: 2.1 time: 0.162712 May 23 17:18:40.822679 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 67/129] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:40 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:41.474954 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2f987283-23ba-4a68-aa32-b902099f9178 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:41.476336 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2f987283-23ba-4a68-aa32-b902099f9178 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] [instance: 531aeff0-e028-4f24-9d36-a48492b18414] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:41.478662 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=60 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:41.484323 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2f987283-23ba-4a68-aa32-b902099f9178 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:41.484802 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2f987283-23ba-4a68-aa32-b902099f9178 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:41.485572 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2f987283-23ba-4a68-aa32-b902099f9178 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:41.485996 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2f987283-23ba-4a68-aa32-b902099f9178 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:41.512881 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2f987283-23ba-4a68-aa32-b902099f9178 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] [instance: 531aeff0-e028-4f24-9d36-a48492b18414] Going to try to terminate instance {{(pid=117909) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 17:18:41.617646 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2f987283-23ba-4a68-aa32-b902099f9178 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] 10.222.0.46 "DELETE /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414" status: 204 len: 0 microversion: 2.1 time: 0.146062 May 23 17:18:41.618305 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 63/130] 10.222.0.46 () {58 vars in 1238 bytes} [Mon May 23 17:18:41 2022] DELETE /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 17:18:41.627950 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-34793100-e123-458e-b6a5-4743aff9df6e tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:41.628899 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-34793100-e123-458e-b6a5-4743aff9df6e tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] [instance: 531aeff0-e028-4f24-9d36-a48492b18414] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:41.636192 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-34793100-e123-458e-b6a5-4743aff9df6e tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:41.636708 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-34793100-e123-458e-b6a5-4743aff9df6e tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:41.637730 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-34793100-e123-458e-b6a5-4743aff9df6e tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:41.638120 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-34793100-e123-458e-b6a5-4743aff9df6e tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:41.792944 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-34793100-e123-458e-b6a5-4743aff9df6e tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0429f5d2715a4487a39281edbd941fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd50da000f94eeca1c4f6ab9867d4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:41.804648 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-34793100-e123-458e-b6a5-4743aff9df6e tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] 10.222.0.46 "GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414" status: 200 len: 1555 microversion: 2.1 time: 0.181498 May 23 17:18:41.805832 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 68/131] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:41 2022] GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414 => generated 1555 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:41.840292 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-384f8922-7942-4b0e-b7f1-1cfaeadf395d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:41.840933 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-384f8922-7942-4b0e-b7f1-1cfaeadf395d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:41.848333 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-384f8922-7942-4b0e-b7f1-1cfaeadf395d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:41.848826 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-384f8922-7942-4b0e-b7f1-1cfaeadf395d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:41.849622 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-384f8922-7942-4b0e-b7f1-1cfaeadf395d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:41.850060 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-384f8922-7942-4b0e-b7f1-1cfaeadf395d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:41.989202 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-384f8922-7942-4b0e-b7f1-1cfaeadf395d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:41.997035 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:42.000020 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-384f8922-7942-4b0e-b7f1-1cfaeadf395d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1522 microversion: 2.1 time: 0.165463 May 23 17:18:42.001134 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 64/132] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:41 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:42.827092 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-50313469-a425-45ae-84b3-2b6c03ec987c tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:42.830332 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-50313469-a425-45ae-84b3-2b6c03ec987c tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] [instance: 531aeff0-e028-4f24-9d36-a48492b18414] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:42.840269 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-50313469-a425-45ae-84b3-2b6c03ec987c tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:42.841204 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-50313469-a425-45ae-84b3-2b6c03ec987c tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:42.842731 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-50313469-a425-45ae-84b3-2b6c03ec987c tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:42.843158 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-50313469-a425-45ae-84b3-2b6c03ec987c tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:43.018372 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a374d5b0-7494-4e6f-9c19-face5c8630e2 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:43.019019 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a374d5b0-7494-4e6f-9c19-face5c8630e2 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:43.022454 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-50313469-a425-45ae-84b3-2b6c03ec987c tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0429f5d2715a4487a39281edbd941fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd50da000f94eeca1c4f6ab9867d4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:43.026465 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a374d5b0-7494-4e6f-9c19-face5c8630e2 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:43.027187 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a374d5b0-7494-4e6f-9c19-face5c8630e2 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:43.028176 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a374d5b0-7494-4e6f-9c19-face5c8630e2 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:43.029094 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a374d5b0-7494-4e6f-9c19-face5c8630e2 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:43.032594 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-50313469-a425-45ae-84b3-2b6c03ec987c tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] 10.222.0.46 "GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414" status: 200 len: 1555 microversion: 2.1 time: 0.214619 May 23 17:18:43.033579 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 69/133] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:42 2022] GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414 => generated 1555 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:43.244906 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a374d5b0-7494-4e6f-9c19-face5c8630e2 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:43.253284 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a374d5b0-7494-4e6f-9c19-face5c8630e2 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1522 microversion: 2.1 time: 0.239932 May 23 17:18:43.264259 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 65/134] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:43 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:18:44.051009 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c375eac9-c750-4267-9761-35a221f7f54b tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:44.051661 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c375eac9-c750-4267-9761-35a221f7f54b tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] [instance: 531aeff0-e028-4f24-9d36-a48492b18414] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:44.065921 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c375eac9-c750-4267-9761-35a221f7f54b tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:44.066427 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c375eac9-c750-4267-9761-35a221f7f54b tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:44.068207 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c375eac9-c750-4267-9761-35a221f7f54b tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:44.070578 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c375eac9-c750-4267-9761-35a221f7f54b tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:44.274649 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-868e0468-ef58-411e-9193-4eb1134c3599 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:44.276139 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-868e0468-ef58-411e-9193-4eb1134c3599 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:44.296782 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-868e0468-ef58-411e-9193-4eb1134c3599 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:44.297463 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-868e0468-ef58-411e-9193-4eb1134c3599 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:44.298504 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-868e0468-ef58-411e-9193-4eb1134c3599 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:44.299142 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-868e0468-ef58-411e-9193-4eb1134c3599 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:44.542028 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-868e0468-ef58-411e-9193-4eb1134c3599 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:44.562652 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-868e0468-ef58-411e-9193-4eb1134c3599 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1522 microversion: 2.1 time: 0.285710 May 23 17:18:44.568132 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 66/135] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:44 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:44.576480 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-c375eac9-c750-4267-9761-35a221f7f54b tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0429f5d2715a4487a39281edbd941fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd50da000f94eeca1c4f6ab9867d4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:44.587069 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c375eac9-c750-4267-9761-35a221f7f54b tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] 10.222.0.46 "GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414" status: 200 len: 1555 microversion: 2.1 time: 0.540682 May 23 17:18:44.587957 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 70/136] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:44 2022] GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414 => generated 1555 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:45.581211 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-801487df-5774-4153-bb73-bcef517c8ca8 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:45.582592 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-801487df-5774-4153-bb73-bcef517c8ca8 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:45.605657 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-77efc02f-12d7-4952-bd76-0b459c31b500 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:45.606645 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-801487df-5774-4153-bb73-bcef517c8ca8 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:45.607074 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-77efc02f-12d7-4952-bd76-0b459c31b500 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] [instance: 531aeff0-e028-4f24-9d36-a48492b18414] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:45.607222 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-801487df-5774-4153-bb73-bcef517c8ca8 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:45.613600 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-801487df-5774-4153-bb73-bcef517c8ca8 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:45.614071 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-801487df-5774-4153-bb73-bcef517c8ca8 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:45.623280 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-77efc02f-12d7-4952-bd76-0b459c31b500 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:45.624915 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-77efc02f-12d7-4952-bd76-0b459c31b500 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:45.626013 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-77efc02f-12d7-4952-bd76-0b459c31b500 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:45.628005 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-77efc02f-12d7-4952-bd76-0b459c31b500 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:45.802824 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-77efc02f-12d7-4952-bd76-0b459c31b500 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0429f5d2715a4487a39281edbd941fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd50da000f94eeca1c4f6ab9867d4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:45.811105 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-77efc02f-12d7-4952-bd76-0b459c31b500 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] 10.222.0.46 "GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414" status: 200 len: 1513 microversion: 2.1 time: 0.210049 May 23 17:18:45.811688 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 71/137] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:45 2022] GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414 => generated 1513 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:45.828306 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-d6549363-3938-4849-b9aa-1a6cac4afce6 req-3f439542-ddba-49ce-b7a0-7eba56c0f92c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "531aeff0-e028-4f24-9d36-a48492b18414", "name": "network-vif-deleted", "tag": "5629b784-503a-468a-9ee8-3b6e4a0d377d"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:18:45.849531 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-d6549363-3938-4849-b9aa-1a6cac4afce6 req-3f439542-ddba-49ce-b7a0-7eba56c0f92c service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:45.849961 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-d6549363-3938-4849-b9aa-1a6cac4afce6 req-3f439542-ddba-49ce-b7a0-7eba56c0f92c service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:45.879781 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-d6549363-3938-4849-b9aa-1a6cac4afce6 req-3f439542-ddba-49ce-b7a0-7eba56c0f92c service nova] Creating event network-vif-deleted:5629b784-503a-468a-9ee8-3b6e4a0d377d for instance 531aeff0-e028-4f24-9d36-a48492b18414 on hv-cinder-84299 May 23 17:18:45.886752 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-d6549363-3938-4849-b9aa-1a6cac4afce6 req-3f439542-ddba-49ce-b7a0-7eba56c0f92c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062035 May 23 17:18:45.887880 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 72/138] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:18:45.903848 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-801487df-5774-4153-bb73-bcef517c8ca8 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:45.914284 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-801487df-5774-4153-bb73-bcef517c8ca8 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1522 microversion: 2.1 time: 0.337814 May 23 17:18:45.921814 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 67/139] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:45 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:46.828634 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-ffe443a2-a856-4385-9c9d-028c9dc67091 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:46.829520 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-ffe443a2-a856-4385-9c9d-028c9dc67091 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] [instance: 531aeff0-e028-4f24-9d36-a48492b18414] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:46.837159 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ffe443a2-a856-4385-9c9d-028c9dc67091 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:46.837610 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ffe443a2-a856-4385-9c9d-028c9dc67091 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:46.838418 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ffe443a2-a856-4385-9c9d-028c9dc67091 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:46.838881 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ffe443a2-a856-4385-9c9d-028c9dc67091 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:46.913036 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ffe443a2-a856-4385-9c9d-028c9dc67091 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:46.914771 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ffe443a2-a856-4385-9c9d-028c9dc67091 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:46.915380 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.objects.instance [None req-ffe443a2-a856-4385-9c9d-028c9dc67091 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lazy-loading 'fault' on Instance uuid 531aeff0-e028-4f24-9d36-a48492b18414 {{(pid=117910) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 17:18:46.925426 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:18:46.938103 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-17667f4d-e629-4356-a5a5-8eac1185b84e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:46.938808 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-17667f4d-e629-4356-a5a5-8eac1185b84e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:46.954255 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-17667f4d-e629-4356-a5a5-8eac1185b84e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:46.955124 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-17667f4d-e629-4356-a5a5-8eac1185b84e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:46.957270 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-17667f4d-e629-4356-a5a5-8eac1185b84e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:46.960392 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-17667f4d-e629-4356-a5a5-8eac1185b84e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:46.983282 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ffe443a2-a856-4385-9c9d-028c9dc67091 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0429f5d2715a4487a39281edbd941fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd50da000f94eeca1c4f6ab9867d4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:47.016418 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-ffe443a2-a856-4385-9c9d-028c9dc67091 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] 10.222.0.46 "GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414" status: 200 len: 1351 microversion: 2.1 time: 0.192392 May 23 17:18:47.017089 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 73/140] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:46 2022] GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414 => generated 1351 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:47.155084 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-17667f4d-e629-4356-a5a5-8eac1185b84e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:47.164273 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-17667f4d-e629-4356-a5a5-8eac1185b84e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1522 microversion: 2.1 time: 0.233500 May 23 17:18:47.168650 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 68/141] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:46 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:48.037356 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-7fcf0ff7-359d-4221-b4b6-bfbc4ae6bf29 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:48.038584 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-7fcf0ff7-359d-4221-b4b6-bfbc4ae6bf29 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] [instance: 531aeff0-e028-4f24-9d36-a48492b18414] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:48.049224 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7fcf0ff7-359d-4221-b4b6-bfbc4ae6bf29 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:48.050501 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7fcf0ff7-359d-4221-b4b6-bfbc4ae6bf29 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:48.051479 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7fcf0ff7-359d-4221-b4b6-bfbc4ae6bf29 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:48.052863 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7fcf0ff7-359d-4221-b4b6-bfbc4ae6bf29 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:48.071887 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-7fcf0ff7-359d-4221-b4b6-bfbc4ae6bf29 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] HTTP exception thrown: Instance 531aeff0-e028-4f24-9d36-a48492b18414 could not be found. May 23 17:18:48.076988 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-7fcf0ff7-359d-4221-b4b6-bfbc4ae6bf29 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Request method failure captured: May 23 17:18:48.076988 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: request: GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414 HTTP/1.1 May 23 17:18:48.076988 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept: application/json May 23 17:18:48.076988 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity May 23 17:18:48.076988 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Connection: close May 23 17:18:48.076988 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Length: 0 May 23 17:18:48.076988 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Type: application/json May 23 17:18:48.076988 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Host: 10.222.0.46 May 23 17:18:48.076988 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None May 23 17:18:48.076988 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.9 May 23 17:18:48.076988 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABii8GzitSD0r58KsamBkGMB-XTSvSeYihUEO4sJR2D9exn_U0LyLIxuruBjxw48JBOndmuUSoDzhy-f6NpS1d9ISis4vRAQf61Vz-XIKEr3xMCL1fXY4d1Luh3q5Yw24cbFQ7YMJhF8f-tE0bn4-MU6aqyLssXWatduyrop5U0XPfuvXk May 23 17:18:48.076988 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Id: None May 23 17:18:48.076988 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Name: None May 23 17:18:48.076988 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed May 23 17:18:48.076988 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True May 23 17:18:48.076988 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default May 23 17:18:48.076988 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default May 23 17:18:48.076988 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Id: 9dd50da000f94eeca1c4f6ab9867d4d6 May 23 17:18:48.076988 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-DeleteServersTestJSON-1410584436 May 23 17:18:48.076988 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Role: reader,member May 23 17:18:48.076988 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Roles: reader,member May 23 17:18:48.078257 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9dd50da000f94eeca1c4f6ab9867d4d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9dd50da000f94eeca1c4f6ab9867d4d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9dd50da000f94eeca1c4f6ab9867d4d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9dd50da000f94eeca1c4f6ab9867d4d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:18:48.078257 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-DeleteServersTestJSON-1410584436 May 23 17:18:48.078257 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 9dd50da000f94eeca1c4f6ab9867d4d6 May 23 17:18:48.078257 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-DeleteServersTestJSON-1410584436 May 23 17:18:48.078257 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User: tempest-DeleteServersTestJSON-1410584436-project May 23 17:18:48.078257 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default May 23 17:18:48.078257 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default May 23 17:18:48.078257 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Id: 0429f5d2715a4487a39281edbd941fbd May 23 17:18:48.078257 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-DeleteServersTestJSON-1410584436-project May 23 17:18:48.078257 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: method: > May 23 17:18:48.078257 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: exception: Instance 531aeff0-e028-4f24-9d36-a48492b18414 could not be found. May 23 17:18:48.078257 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: action_args: {'id': '531aeff0-e028-4f24-9d36-a48492b18414'} May 23 17:18:48.078977 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:18:48.078977 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:18:48.078977 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:18:48.078977 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:18:48.078977 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:18:48.078977 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:18:48.078977 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:18:48.078977 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:18:48.078977 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:18:48.078977 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:18:48.078977 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 531aeff0-e028-4f24-9d36-a48492b18414 could not be found. May 23 17:18:48.078977 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:48.078977 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:18:48.078977 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:48.078977 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:18:48.078977 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:18:48.078977 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:18:48.078977 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:18:48.078977 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:18:48.078977 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:18:48.080097 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:18:48.080097 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 17:18:48.080097 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 17:18:48.080097 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:18:48.080097 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:18:48.080097 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:18:48.080097 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:18:48.080097 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 531aeff0-e028-4f24-9d36-a48492b18414 could not be found. May 23 17:18:48.080097 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:48.080097 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:18:48.080097 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:48.080097 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:18:48.080097 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:18:48.080097 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:18:48.080097 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:18:48.080097 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:18:48.080097 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 531aeff0-e028-4f24-9d36-a48492b18414 could not be found. May 23 17:18:48.080097 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:48.081995 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-7fcf0ff7-359d-4221-b4b6-bfbc4ae6bf29 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Returning 404 to user: Instance 531aeff0-e028-4f24-9d36-a48492b18414 could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:18:48.083140 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-7fcf0ff7-359d-4221-b4b6-bfbc4ae6bf29 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] 10.222.0.46 "GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414" status: 404 len: 111 microversion: 2.1 time: 0.052646 May 23 17:18:48.092674 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 74/142] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:48 2022] GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:18:48.180559 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-819961b7-099b-45bb-bf7d-cf5ce8b2f13d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:48.181382 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-819961b7-099b-45bb-bf7d-cf5ce8b2f13d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:48.187703 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-819961b7-099b-45bb-bf7d-cf5ce8b2f13d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:48.188500 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-819961b7-099b-45bb-bf7d-cf5ce8b2f13d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:48.189563 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-819961b7-099b-45bb-bf7d-cf5ce8b2f13d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:48.190195 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-819961b7-099b-45bb-bf7d-cf5ce8b2f13d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:48.351634 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-819961b7-099b-45bb-bf7d-cf5ce8b2f13d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:48.352435 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-033e74f5-4730-46ab-98b1-11cfe4c5c79e tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:48.353787 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-033e74f5-4730-46ab-98b1-11cfe4c5c79e tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] [instance: 531aeff0-e028-4f24-9d36-a48492b18414] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:48.360140 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-033e74f5-4730-46ab-98b1-11cfe4c5c79e tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:48.360714 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-033e74f5-4730-46ab-98b1-11cfe4c5c79e tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:48.361726 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-033e74f5-4730-46ab-98b1-11cfe4c5c79e tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:48.362505 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-033e74f5-4730-46ab-98b1-11cfe4c5c79e tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:48.364835 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-819961b7-099b-45bb-bf7d-cf5ce8b2f13d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1522 microversion: 2.1 time: 0.188073 May 23 17:18:48.369152 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 69/143] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:48 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:48.380263 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-033e74f5-4730-46ab-98b1-11cfe4c5c79e tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] HTTP exception thrown: Instance 531aeff0-e028-4f24-9d36-a48492b18414 could not be found. May 23 17:18:48.381555 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-033e74f5-4730-46ab-98b1-11cfe4c5c79e tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Request method failure captured: May 23 17:18:48.381555 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: request: GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414/os-volume_attachments HTTP/1.1 May 23 17:18:48.381555 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept: application/json May 23 17:18:48.381555 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity May 23 17:18:48.381555 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Connection: close May 23 17:18:48.381555 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Length: 0 May 23 17:18:48.381555 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Type: application/json May 23 17:18:48.381555 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Host: 10.222.0.46 May 23 17:18:48.381555 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None May 23 17:18:48.381555 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.9 May 23 17:18:48.381555 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABii8GzitSD0r58KsamBkGMB-XTSvSeYihUEO4sJR2D9exn_U0LyLIxuruBjxw48JBOndmuUSoDzhy-f6NpS1d9ISis4vRAQf61Vz-XIKEr3xMCL1fXY4d1Luh3q5Yw24cbFQ7YMJhF8f-tE0bn4-MU6aqyLssXWatduyrop5U0XPfuvXk May 23 17:18:48.381555 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Id: None May 23 17:18:48.381555 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Name: None May 23 17:18:48.381555 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed May 23 17:18:48.381555 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True May 23 17:18:48.381555 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default May 23 17:18:48.381555 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default May 23 17:18:48.381555 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Id: 9dd50da000f94eeca1c4f6ab9867d4d6 May 23 17:18:48.381555 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-DeleteServersTestJSON-1410584436 May 23 17:18:48.381555 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Role: reader,member May 23 17:18:48.381555 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Roles: reader,member May 23 17:18:48.383011 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9dd50da000f94eeca1c4f6ab9867d4d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9dd50da000f94eeca1c4f6ab9867d4d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9dd50da000f94eeca1c4f6ab9867d4d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9dd50da000f94eeca1c4f6ab9867d4d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:18:48.383011 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-DeleteServersTestJSON-1410584436 May 23 17:18:48.383011 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 9dd50da000f94eeca1c4f6ab9867d4d6 May 23 17:18:48.383011 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-DeleteServersTestJSON-1410584436 May 23 17:18:48.383011 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User: tempest-DeleteServersTestJSON-1410584436-project May 23 17:18:48.383011 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default May 23 17:18:48.383011 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default May 23 17:18:48.383011 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Id: 0429f5d2715a4487a39281edbd941fbd May 23 17:18:48.383011 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-DeleteServersTestJSON-1410584436-project May 23 17:18:48.383011 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: method: > May 23 17:18:48.383011 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: exception: Instance 531aeff0-e028-4f24-9d36-a48492b18414 could not be found. May 23 17:18:48.383011 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: action_args: {'server_id': '531aeff0-e028-4f24-9d36-a48492b18414'} May 23 17:18:48.383810 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:18:48.383810 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:18:48.383810 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:18:48.383810 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:18:48.383810 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:18:48.383810 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:18:48.383810 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:18:48.383810 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:18:48.383810 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:18:48.383810 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:18:48.383810 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 531aeff0-e028-4f24-9d36-a48492b18414 could not be found. May 23 17:18:48.383810 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:48.383810 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:18:48.383810 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:48.383810 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:18:48.383810 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:18:48.383810 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:18:48.383810 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:18:48.383810 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:18:48.383810 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:18:48.385390 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:18:48.385390 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 23 17:18:48.385390 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 17:18:48.385390 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 23 17:18:48.385390 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 17:18:48.385390 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 23 17:18:48.385390 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 23 17:18:48.385390 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:18:48.385390 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:18:48.385390 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 531aeff0-e028-4f24-9d36-a48492b18414 could not be found. May 23 17:18:48.385390 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:48.385390 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:18:48.385390 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:48.385390 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:18:48.385390 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:18:48.385390 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:18:48.385390 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:18:48.385390 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:18:48.385390 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 531aeff0-e028-4f24-9d36-a48492b18414 could not be found. May 23 17:18:48.385390 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:48.387696 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-033e74f5-4730-46ab-98b1-11cfe4c5c79e tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Returning 404 to user: Instance 531aeff0-e028-4f24-9d36-a48492b18414 could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:18:48.389833 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-033e74f5-4730-46ab-98b1-11cfe4c5c79e tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] 10.222.0.46 "GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.041749 May 23 17:18:48.391027 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 75/144] 10.222.0.46 () {58 vars in 1301 bytes} [Mon May 23 17:18:48 2022] GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414/os-volume_attachments => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 17:18:49.382240 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0b7da3b8-037d-486f-9404-f213dfe99c25 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:49.382899 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0b7da3b8-037d-486f-9404-f213dfe99c25 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:49.393324 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0b7da3b8-037d-486f-9404-f213dfe99c25 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:49.394114 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0b7da3b8-037d-486f-9404-f213dfe99c25 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:49.395437 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0b7da3b8-037d-486f-9404-f213dfe99c25 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:49.396199 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0b7da3b8-037d-486f-9404-f213dfe99c25 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:49.540115 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0b7da3b8-037d-486f-9404-f213dfe99c25 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:49.551609 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0b7da3b8-037d-486f-9404-f213dfe99c25 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1522 microversion: 2.1 time: 0.173209 May 23 17:18:49.552421 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 70/145] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:49 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:50.571628 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-20e26c49-f48c-42f3-b427-c50c6aca2634 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:50.572197 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-20e26c49-f48c-42f3-b427-c50c6aca2634 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:50.579354 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-20e26c49-f48c-42f3-b427-c50c6aca2634 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:50.579802 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-20e26c49-f48c-42f3-b427-c50c6aca2634 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:50.580575 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-20e26c49-f48c-42f3-b427-c50c6aca2634 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:50.581075 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-20e26c49-f48c-42f3-b427-c50c6aca2634 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:50.716556 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-20e26c49-f48c-42f3-b427-c50c6aca2634 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:50.727865 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-20e26c49-f48c-42f3-b427-c50c6aca2634 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1522 microversion: 2.1 time: 0.160081 May 23 17:18:50.728464 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 76/146] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:50 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:51.745286 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8759e4d8-e310-4a84-9348-2e075cd891d7 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:51.745904 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8759e4d8-e310-4a84-9348-2e075cd891d7 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:51.752503 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8759e4d8-e310-4a84-9348-2e075cd891d7 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:51.752994 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8759e4d8-e310-4a84-9348-2e075cd891d7 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:51.753788 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8759e4d8-e310-4a84-9348-2e075cd891d7 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:51.754195 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8759e4d8-e310-4a84-9348-2e075cd891d7 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:51.896301 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8759e4d8-e310-4a84-9348-2e075cd891d7 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:51.905955 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8759e4d8-e310-4a84-9348-2e075cd891d7 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1522 microversion: 2.1 time: 0.164575 May 23 17:18:51.906836 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 71/147] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:51 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:52.847687 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b983b6b2-4f49-46dd-9b81-ee3fdb7815a5 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:52.848191 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-b983b6b2-4f49-46dd-9b81-ee3fdb7815a5 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] [instance: 531aeff0-e028-4f24-9d36-a48492b18414] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:52.855931 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b983b6b2-4f49-46dd-9b81-ee3fdb7815a5 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:52.856494 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b983b6b2-4f49-46dd-9b81-ee3fdb7815a5 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:52.858438 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b983b6b2-4f49-46dd-9b81-ee3fdb7815a5 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:52.858961 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b983b6b2-4f49-46dd-9b81-ee3fdb7815a5 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:52.875393 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-b983b6b2-4f49-46dd-9b81-ee3fdb7815a5 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] HTTP exception thrown: Instance 531aeff0-e028-4f24-9d36-a48492b18414 could not be found. May 23 17:18:52.877132 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b983b6b2-4f49-46dd-9b81-ee3fdb7815a5 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Request method failure captured: May 23 17:18:52.877132 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: request: DELETE /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414 HTTP/1.1 May 23 17:18:52.877132 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept: application/json May 23 17:18:52.877132 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity May 23 17:18:52.877132 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Connection: close May 23 17:18:52.877132 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Length: 0 May 23 17:18:52.877132 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Type: application/json May 23 17:18:52.877132 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Host: 10.222.0.46 May 23 17:18:52.877132 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None May 23 17:18:52.877132 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.9 May 23 17:18:52.877132 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABii8GzitSD0r58KsamBkGMB-XTSvSeYihUEO4sJR2D9exn_U0LyLIxuruBjxw48JBOndmuUSoDzhy-f6NpS1d9ISis4vRAQf61Vz-XIKEr3xMCL1fXY4d1Luh3q5Yw24cbFQ7YMJhF8f-tE0bn4-MU6aqyLssXWatduyrop5U0XPfuvXk May 23 17:18:52.877132 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Id: None May 23 17:18:52.877132 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Name: None May 23 17:18:52.877132 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed May 23 17:18:52.877132 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True May 23 17:18:52.877132 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default May 23 17:18:52.877132 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default May 23 17:18:52.877132 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Id: 9dd50da000f94eeca1c4f6ab9867d4d6 May 23 17:18:52.877132 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-DeleteServersTestJSON-1410584436 May 23 17:18:52.877132 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Role: reader,member May 23 17:18:52.877132 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Roles: reader,member May 23 17:18:52.878330 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9dd50da000f94eeca1c4f6ab9867d4d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9dd50da000f94eeca1c4f6ab9867d4d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9dd50da000f94eeca1c4f6ab9867d4d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9dd50da000f94eeca1c4f6ab9867d4d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:18:52.878330 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-DeleteServersTestJSON-1410584436 May 23 17:18:52.878330 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 9dd50da000f94eeca1c4f6ab9867d4d6 May 23 17:18:52.878330 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-DeleteServersTestJSON-1410584436 May 23 17:18:52.878330 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User: tempest-DeleteServersTestJSON-1410584436-project May 23 17:18:52.878330 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default May 23 17:18:52.878330 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default May 23 17:18:52.878330 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Id: 0429f5d2715a4487a39281edbd941fbd May 23 17:18:52.878330 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-DeleteServersTestJSON-1410584436-project May 23 17:18:52.878330 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: method: > May 23 17:18:52.878330 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: exception: Instance 531aeff0-e028-4f24-9d36-a48492b18414 could not be found. May 23 17:18:52.878330 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: action_args: {'id': '531aeff0-e028-4f24-9d36-a48492b18414'} May 23 17:18:52.878972 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:18:52.878972 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:18:52.878972 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:18:52.878972 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:18:52.878972 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:18:52.878972 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:18:52.878972 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:18:52.878972 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:18:52.878972 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:18:52.878972 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:18:52.878972 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 531aeff0-e028-4f24-9d36-a48492b18414 could not be found. May 23 17:18:52.878972 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:52.878972 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:18:52.878972 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:52.878972 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:18:52.878972 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:18:52.878972 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:18:52.878972 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:18:52.878972 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:18:52.878972 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:18:52.880344 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:18:52.880344 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 17:18:52.880344 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 17:18:52.880344 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 17:18:52.880344 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 17:18:52.880344 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:18:52.880344 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:18:52.880344 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:18:52.880344 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:18:52.880344 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 531aeff0-e028-4f24-9d36-a48492b18414 could not be found. May 23 17:18:52.880344 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:52.880344 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:18:52.880344 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:52.880344 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:18:52.880344 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:18:52.880344 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:18:52.880344 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:18:52.880344 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:18:52.880344 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 531aeff0-e028-4f24-9d36-a48492b18414 could not be found. May 23 17:18:52.880344 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:18:52.881663 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b983b6b2-4f49-46dd-9b81-ee3fdb7815a5 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Returning 404 to user: Instance 531aeff0-e028-4f24-9d36-a48492b18414 could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:18:52.881663 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b983b6b2-4f49-46dd-9b81-ee3fdb7815a5 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] 10.222.0.46 "DELETE /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414" status: 404 len: 111 microversion: 2.1 time: 0.034962 May 23 17:18:52.881663 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 77/148] 10.222.0.46 () {58 vars in 1238 bytes} [Mon May 23 17:18:52 2022] DELETE /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:18:52.887146 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f6fd89b1-8ba9-41fe-8da5-cbeadae48587 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:52.887756 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f6fd89b1-8ba9-41fe-8da5-cbeadae48587 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] [instance: 531aeff0-e028-4f24-9d36-a48492b18414] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:52.894458 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f6fd89b1-8ba9-41fe-8da5-cbeadae48587 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:52.894943 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f6fd89b1-8ba9-41fe-8da5-cbeadae48587 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:52.895706 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f6fd89b1-8ba9-41fe-8da5-cbeadae48587 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:52.896298 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f6fd89b1-8ba9-41fe-8da5-cbeadae48587 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:52.910928 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-f6fd89b1-8ba9-41fe-8da5-cbeadae48587 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] HTTP exception thrown: Instance 531aeff0-e028-4f24-9d36-a48492b18414 could not be found. May 23 17:18:52.915497 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f6fd89b1-8ba9-41fe-8da5-cbeadae48587 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Request method failure captured: May 23 17:18:52.915497 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: request: GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414 HTTP/1.1 May 23 17:18:52.915497 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept: application/json May 23 17:18:52.915497 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity May 23 17:18:52.915497 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Connection: close May 23 17:18:52.915497 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Length: 0 May 23 17:18:52.915497 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Type: application/json May 23 17:18:52.915497 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Host: 10.222.0.46 May 23 17:18:52.915497 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None May 23 17:18:52.915497 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.9 May 23 17:18:52.915497 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABii8GzitSD0r58KsamBkGMB-XTSvSeYihUEO4sJR2D9exn_U0LyLIxuruBjxw48JBOndmuUSoDzhy-f6NpS1d9ISis4vRAQf61Vz-XIKEr3xMCL1fXY4d1Luh3q5Yw24cbFQ7YMJhF8f-tE0bn4-MU6aqyLssXWatduyrop5U0XPfuvXk May 23 17:18:52.915497 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Id: None May 23 17:18:52.915497 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Name: None May 23 17:18:52.915497 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed May 23 17:18:52.915497 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True May 23 17:18:52.915497 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default May 23 17:18:52.915497 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default May 23 17:18:52.915497 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Id: 9dd50da000f94eeca1c4f6ab9867d4d6 May 23 17:18:52.915497 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-DeleteServersTestJSON-1410584436 May 23 17:18:52.915497 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Role: reader,member May 23 17:18:52.915497 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Roles: reader,member May 23 17:18:52.916665 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9dd50da000f94eeca1c4f6ab9867d4d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9dd50da000f94eeca1c4f6ab9867d4d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9dd50da000f94eeca1c4f6ab9867d4d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9dd50da000f94eeca1c4f6ab9867d4d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:18:52.916665 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-DeleteServersTestJSON-1410584436 May 23 17:18:52.916665 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 9dd50da000f94eeca1c4f6ab9867d4d6 May 23 17:18:52.916665 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-DeleteServersTestJSON-1410584436 May 23 17:18:52.916665 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User: tempest-DeleteServersTestJSON-1410584436-project May 23 17:18:52.916665 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default May 23 17:18:52.916665 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default May 23 17:18:52.916665 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Id: 0429f5d2715a4487a39281edbd941fbd May 23 17:18:52.916665 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-DeleteServersTestJSON-1410584436-project May 23 17:18:52.916665 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: method: > May 23 17:18:52.916665 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: exception: Instance 531aeff0-e028-4f24-9d36-a48492b18414 could not be found. May 23 17:18:52.916665 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: action_args: {'id': '531aeff0-e028-4f24-9d36-a48492b18414'} May 23 17:18:52.917391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:18:52.917391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:18:52.917391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:18:52.917391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:18:52.917391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:18:52.917391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:18:52.917391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:18:52.917391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:18:52.917391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:18:52.917391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:18:52.917391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 531aeff0-e028-4f24-9d36-a48492b18414 could not be found. May 23 17:18:52.917391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:18:52.917391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:18:52.917391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:18:52.917391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:18:52.917391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:18:52.917391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:18:52.917391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:18:52.917391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:18:52.917391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:18:52.918419 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:18:52.918419 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 17:18:52.918419 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 17:18:52.918419 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:18:52.918419 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:18:52.918419 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:18:52.918419 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:18:52.918419 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 531aeff0-e028-4f24-9d36-a48492b18414 could not be found. May 23 17:18:52.918419 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:18:52.918419 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:18:52.918419 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:18:52.918419 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:18:52.918419 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:18:52.918419 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:18:52.918419 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:18:52.918419 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:18:52.918419 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 531aeff0-e028-4f24-9d36-a48492b18414 could not be found. May 23 17:18:52.918419 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:18:52.919344 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f6fd89b1-8ba9-41fe-8da5-cbeadae48587 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] Returning 404 to user: Instance 531aeff0-e028-4f24-9d36-a48492b18414 could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:18:52.919344 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f6fd89b1-8ba9-41fe-8da5-cbeadae48587 tempest-DeleteServersTestJSON-1410584436 tempest-DeleteServersTestJSON-1410584436-project] 10.222.0.46 "GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414" status: 404 len: 111 microversion: 2.1 time: 0.033794 May 23 17:18:52.919344 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 72/149] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:52 2022] GET /compute/v2.1/servers/531aeff0-e028-4f24-9d36-a48492b18414 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:18:52.923444 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b11c0c97-16e2-4e20-b3c0-863774cdf555 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:52.924057 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-b11c0c97-16e2-4e20-b3c0-863774cdf555 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:52.930240 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b11c0c97-16e2-4e20-b3c0-863774cdf555 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:52.930900 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b11c0c97-16e2-4e20-b3c0-863774cdf555 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:52.931825 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b11c0c97-16e2-4e20-b3c0-863774cdf555 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:52.932320 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b11c0c97-16e2-4e20-b3c0-863774cdf555 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:53.078843 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b11c0c97-16e2-4e20-b3c0-863774cdf555 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:53.087137 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b11c0c97-16e2-4e20-b3c0-863774cdf555 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1522 microversion: 2.1 time: 0.167527 May 23 17:18:53.087696 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 78/150] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:52 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:54.103787 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9641429a-230d-4f55-8553-70fa4cbb25e7 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:54.104498 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9641429a-230d-4f55-8553-70fa4cbb25e7 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:54.129234 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9641429a-230d-4f55-8553-70fa4cbb25e7 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:54.130231 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9641429a-230d-4f55-8553-70fa4cbb25e7 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:54.131156 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9641429a-230d-4f55-8553-70fa4cbb25e7 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:54.131653 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9641429a-230d-4f55-8553-70fa4cbb25e7 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:54.321369 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9641429a-230d-4f55-8553-70fa4cbb25e7 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:54.333844 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9641429a-230d-4f55-8553-70fa4cbb25e7 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1522 microversion: 2.1 time: 0.234228 May 23 17:18:54.334929 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 73/151] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:54 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:55.351871 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-151849f1-9a6c-409c-90ef-bb7a002fa545 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:55.352584 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-151849f1-9a6c-409c-90ef-bb7a002fa545 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:55.359557 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-151849f1-9a6c-409c-90ef-bb7a002fa545 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:55.360128 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-151849f1-9a6c-409c-90ef-bb7a002fa545 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:55.361260 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-151849f1-9a6c-409c-90ef-bb7a002fa545 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:55.361910 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-151849f1-9a6c-409c-90ef-bb7a002fa545 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:55.519807 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-151849f1-9a6c-409c-90ef-bb7a002fa545 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:55.527388 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-151849f1-9a6c-409c-90ef-bb7a002fa545 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1522 microversion: 2.1 time: 0.179786 May 23 17:18:55.527959 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 79/152] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:55 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:56.544725 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ade95216-f57b-4421-9d72-fda91e300e22 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:56.545580 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ade95216-f57b-4421-9d72-fda91e300e22 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:56.555038 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ade95216-f57b-4421-9d72-fda91e300e22 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:56.555598 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ade95216-f57b-4421-9d72-fda91e300e22 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:56.557007 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ade95216-f57b-4421-9d72-fda91e300e22 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:56.557454 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ade95216-f57b-4421-9d72-fda91e300e22 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:56.711400 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ade95216-f57b-4421-9d72-fda91e300e22 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:56.718812 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ade95216-f57b-4421-9d72-fda91e300e22 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1522 microversion: 2.1 time: 0.178238 May 23 17:18:56.719582 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 74/153] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:56 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:57.736634 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d53c8cfb-2943-479a-a854-3cc6b1add8d2 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:57.737531 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d53c8cfb-2943-479a-a854-3cc6b1add8d2 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:57.744050 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d53c8cfb-2943-479a-a854-3cc6b1add8d2 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:57.744313 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d53c8cfb-2943-479a-a854-3cc6b1add8d2 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:57.745207 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d53c8cfb-2943-479a-a854-3cc6b1add8d2 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:57.745650 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d53c8cfb-2943-479a-a854-3cc6b1add8d2 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:57.893760 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d53c8cfb-2943-479a-a854-3cc6b1add8d2 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:57.901560 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d53c8cfb-2943-479a-a854-3cc6b1add8d2 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1522 microversion: 2.1 time: 0.170014 May 23 17:18:57.902209 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 80/154] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:57 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:18:58.924278 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d3d4e975-64b0-43ea-8c5f-84ad3628b8e9 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:18:58.926104 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d3d4e975-64b0-43ea-8c5f-84ad3628b8e9 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:18:58.947220 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d3d4e975-64b0-43ea-8c5f-84ad3628b8e9 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:58.948057 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d3d4e975-64b0-43ea-8c5f-84ad3628b8e9 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:58.959420 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d3d4e975-64b0-43ea-8c5f-84ad3628b8e9 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:18:58.960237 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d3d4e975-64b0-43ea-8c5f-84ad3628b8e9 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:18:59.127278 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d3d4e975-64b0-43ea-8c5f-84ad3628b8e9 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:18:59.136443 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d3d4e975-64b0-43ea-8c5f-84ad3628b8e9 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1522 microversion: 2.1 time: 0.217993 May 23 17:18:59.137220 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 75/155] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:18:58 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:00.158306 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c97bfc08-93dd-4cc5-9c1c-5bb0499527aa tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:00.160433 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c97bfc08-93dd-4cc5-9c1c-5bb0499527aa tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:00.170064 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c97bfc08-93dd-4cc5-9c1c-5bb0499527aa tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:00.170570 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c97bfc08-93dd-4cc5-9c1c-5bb0499527aa tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:00.171335 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c97bfc08-93dd-4cc5-9c1c-5bb0499527aa tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:00.171773 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c97bfc08-93dd-4cc5-9c1c-5bb0499527aa tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:00.450373 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-c97bfc08-93dd-4cc5-9c1c-5bb0499527aa tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:00.463883 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c97bfc08-93dd-4cc5-9c1c-5bb0499527aa tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1522 microversion: 2.1 time: 0.313830 May 23 17:19:00.464646 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 81/156] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:00 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:01.480771 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-750b0fa4-e49a-4332-8241-55a020fb6afe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:01.482144 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-750b0fa4-e49a-4332-8241-55a020fb6afe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:01.491213 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-750b0fa4-e49a-4332-8241-55a020fb6afe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:01.491805 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-750b0fa4-e49a-4332-8241-55a020fb6afe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:01.492776 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-750b0fa4-e49a-4332-8241-55a020fb6afe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:01.493242 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-750b0fa4-e49a-4332-8241-55a020fb6afe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:01.689434 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-750b0fa4-e49a-4332-8241-55a020fb6afe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:01.701104 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-750b0fa4-e49a-4332-8241-55a020fb6afe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1522 microversion: 2.1 time: 0.224194 May 23 17:19:01.713164 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 76/157] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:01 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:02.719434 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-384e039f-21f9-498b-8666-4452c91b433b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:02.720048 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-384e039f-21f9-498b-8666-4452c91b433b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:02.729201 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-384e039f-21f9-498b-8666-4452c91b433b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:02.729874 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-384e039f-21f9-498b-8666-4452c91b433b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:02.731246 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-384e039f-21f9-498b-8666-4452c91b433b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:02.732094 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-384e039f-21f9-498b-8666-4452c91b433b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:03.025734 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-384e039f-21f9-498b-8666-4452c91b433b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:03.036654 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-384e039f-21f9-498b-8666-4452c91b433b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1522 microversion: 2.1 time: 0.320804 May 23 17:19:03.052674 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 82/158] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:02 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1522 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:04.057310 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ebe39a04-e18c-497c-9fb7-8e940bc46dda tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:04.058038 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ebe39a04-e18c-497c-9fb7-8e940bc46dda tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:04.073791 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ebe39a04-e18c-497c-9fb7-8e940bc46dda tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:04.075264 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ebe39a04-e18c-497c-9fb7-8e940bc46dda tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:04.076191 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ebe39a04-e18c-497c-9fb7-8e940bc46dda tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:04.076678 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ebe39a04-e18c-497c-9fb7-8e940bc46dda tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:04.361055 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ebe39a04-e18c-497c-9fb7-8e940bc46dda tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:04.375690 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ebe39a04-e18c-497c-9fb7-8e940bc46dda tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1522 microversion: 2.1 time: 0.324136 May 23 17:19:04.385016 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 77/159] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:04 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1522 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:05.393003 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-176b0101-2f13-41ac-aaf7-93b2380fb0a4 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:05.393749 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-176b0101-2f13-41ac-aaf7-93b2380fb0a4 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:05.402826 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-176b0101-2f13-41ac-aaf7-93b2380fb0a4 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:05.403281 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-176b0101-2f13-41ac-aaf7-93b2380fb0a4 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:05.404196 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-176b0101-2f13-41ac-aaf7-93b2380fb0a4 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:05.404673 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-176b0101-2f13-41ac-aaf7-93b2380fb0a4 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:05.587617 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-176b0101-2f13-41ac-aaf7-93b2380fb0a4 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:05.595701 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-176b0101-2f13-41ac-aaf7-93b2380fb0a4 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1522 microversion: 2.1 time: 0.207520 May 23 17:19:05.596301 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 83/160] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:05 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:06.613109 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-130caa45-5dec-4251-af86-14d80869cfb5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:06.614461 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-130caa45-5dec-4251-af86-14d80869cfb5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:06.624408 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-130caa45-5dec-4251-af86-14d80869cfb5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:06.625971 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-130caa45-5dec-4251-af86-14d80869cfb5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:06.627462 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-130caa45-5dec-4251-af86-14d80869cfb5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:06.629096 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-130caa45-5dec-4251-af86-14d80869cfb5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:06.857246 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-130caa45-5dec-4251-af86-14d80869cfb5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:06.865955 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-130caa45-5dec-4251-af86-14d80869cfb5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1522 microversion: 2.1 time: 0.256962 May 23 17:19:06.867362 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 78/161] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:06 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:07.884466 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-91953d23-e164-4229-b68d-5f5a2d5d2b7a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:07.885312 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-91953d23-e164-4229-b68d-5f5a2d5d2b7a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:07.894028 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-91953d23-e164-4229-b68d-5f5a2d5d2b7a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:07.894827 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-91953d23-e164-4229-b68d-5f5a2d5d2b7a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:07.895829 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-91953d23-e164-4229-b68d-5f5a2d5d2b7a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:07.896487 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-91953d23-e164-4229-b68d-5f5a2d5d2b7a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:08.092684 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-91953d23-e164-4229-b68d-5f5a2d5d2b7a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:08.101375 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-91953d23-e164-4229-b68d-5f5a2d5d2b7a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1522 microversion: 2.1 time: 0.221699 May 23 17:19:08.104941 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 84/162] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:07 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:09.117621 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-83ca5e2c-c6b5-4ede-b54d-bd3ff80b12aa tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:09.119288 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-83ca5e2c-c6b5-4ede-b54d-bd3ff80b12aa tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:09.128201 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-83ca5e2c-c6b5-4ede-b54d-bd3ff80b12aa tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:09.129100 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-83ca5e2c-c6b5-4ede-b54d-bd3ff80b12aa tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:09.130220 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-83ca5e2c-c6b5-4ede-b54d-bd3ff80b12aa tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:09.130874 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-83ca5e2c-c6b5-4ede-b54d-bd3ff80b12aa tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:09.537048 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-83ca5e2c-c6b5-4ede-b54d-bd3ff80b12aa tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:09.557011 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-83ca5e2c-c6b5-4ede-b54d-bd3ff80b12aa tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1522 microversion: 2.1 time: 0.440147 May 23 17:19:09.559415 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 79/163] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:09 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1522 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:19:10.573937 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-729ff18e-afdc-4fa9-bf24-45932268819a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:10.574611 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-729ff18e-afdc-4fa9-bf24-45932268819a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:10.588736 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-729ff18e-afdc-4fa9-bf24-45932268819a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:10.589568 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-729ff18e-afdc-4fa9-bf24-45932268819a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:10.590751 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-729ff18e-afdc-4fa9-bf24-45932268819a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:10.591682 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-729ff18e-afdc-4fa9-bf24-45932268819a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:10.930623 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-729ff18e-afdc-4fa9-bf24-45932268819a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:10.951005 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-729ff18e-afdc-4fa9-bf24-45932268819a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1522 microversion: 2.1 time: 0.380861 May 23 17:19:10.952024 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 85/164] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:10 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1522 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:11.968466 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-017b4d30-ce47-46fb-8ed1-bf9e8373a3f3 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:11.975575 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-017b4d30-ce47-46fb-8ed1-bf9e8373a3f3 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:11.982341 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:11.984249 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-017b4d30-ce47-46fb-8ed1-bf9e8373a3f3 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:11.984971 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-017b4d30-ce47-46fb-8ed1-bf9e8373a3f3 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:11.986108 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-017b4d30-ce47-46fb-8ed1-bf9e8373a3f3 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:11.986703 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-017b4d30-ce47-46fb-8ed1-bf9e8373a3f3 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:12.160654 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-017b4d30-ce47-46fb-8ed1-bf9e8373a3f3 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:12.169644 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-017b4d30-ce47-46fb-8ed1-bf9e8373a3f3 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1522 microversion: 2.1 time: 0.205144 May 23 17:19:12.170420 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 80/165] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:11 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:19:12.402934 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e49ca913-8586-4f22-bc3d-4a5567d4ee53 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Action: 'create', calling method: .version_select at 0x7fd7a0756f70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-423638123", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIPSepHtZcdLOjbUaw9VNby0LACIGgGsrfQRoOrR1aSH0vGy0JZpSa1cwUr3zJ8puFvXrQZskN+D3IaA7knaJFrqx+kTKiW/qdbrqt5qNg7LtncRGliIlj/D96l90ytNw=="}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:19:12.407325 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=40 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:12.428817 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-e49ca913-8586-4f22-bc3d-4a5567d4ee53 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Getting quotas for project df984bae4f4e4d01ac06870bee8a73bf. Resources: {'key_pairs'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 17:19:12.433181 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-e49ca913-8586-4f22-bc3d-4a5567d4ee53 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Getting quotas for user dc9c9dd337834dea821cc4ea6ecc10a6 and project df984bae4f4e4d01ac06870bee8a73bf. Resources: {'key_pairs'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 17:19:12.475505 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-e49ca913-8586-4f22-bc3d-4a5567d4ee53 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.285908 May 23 17:19:12.477505 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 86/166] 10.222.0.46 () {60 vars in 1158 bytes} [Mon May 23 17:19:12 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:19:13.186704 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d9062024-8ef5-4e3d-be34-5fe343462b73 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:13.188212 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d9062024-8ef5-4e3d-be34-5fe343462b73 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:13.204330 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d9062024-8ef5-4e3d-be34-5fe343462b73 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:13.205521 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d9062024-8ef5-4e3d-be34-5fe343462b73 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:13.206914 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d9062024-8ef5-4e3d-be34-5fe343462b73 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:13.207852 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d9062024-8ef5-4e3d-be34-5fe343462b73 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:13.212587 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=94 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:13.372333 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d9062024-8ef5-4e3d-be34-5fe343462b73 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:13.380851 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d9062024-8ef5-4e3d-be34-5fe343462b73 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1522 microversion: 2.1 time: 0.197879 May 23 17:19:13.381721 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 81/167] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:13 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:14.400172 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b7ccba1f-e6b0-44c4-9d5b-0100062336ba tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:14.401141 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-b7ccba1f-e6b0-44c4-9d5b-0100062336ba tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:14.409125 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b7ccba1f-e6b0-44c4-9d5b-0100062336ba tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:14.409578 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b7ccba1f-e6b0-44c4-9d5b-0100062336ba tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:14.410361 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b7ccba1f-e6b0-44c4-9d5b-0100062336ba tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:14.410818 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b7ccba1f-e6b0-44c4-9d5b-0100062336ba tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:14.570136 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b7ccba1f-e6b0-44c4-9d5b-0100062336ba tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:14.578856 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b7ccba1f-e6b0-44c4-9d5b-0100062336ba tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1522 microversion: 2.1 time: 0.183921 May 23 17:19:14.588928 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 87/168] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:14 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:15.595448 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5205b817-e634-499e-8022-ba35a3c2b058 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:15.596152 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5205b817-e634-499e-8022-ba35a3c2b058 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:15.603892 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5205b817-e634-499e-8022-ba35a3c2b058 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:15.604509 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5205b817-e634-499e-8022-ba35a3c2b058 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:15.605352 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5205b817-e634-499e-8022-ba35a3c2b058 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:15.605780 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5205b817-e634-499e-8022-ba35a3c2b058 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:15.739775 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5205b817-e634-499e-8022-ba35a3c2b058 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:15.748051 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5205b817-e634-499e-8022-ba35a3c2b058 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1522 microversion: 2.1 time: 0.156607 May 23 17:19:15.748672 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 82/169] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:15 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:16.766514 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-7de923fa-f715-425a-946d-40939a0e6371 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:16.767240 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-7de923fa-f715-425a-946d-40939a0e6371 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:16.774197 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7de923fa-f715-425a-946d-40939a0e6371 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:16.774638 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7de923fa-f715-425a-946d-40939a0e6371 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:16.775680 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7de923fa-f715-425a-946d-40939a0e6371 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:16.776266 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7de923fa-f715-425a-946d-40939a0e6371 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:16.948798 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-7de923fa-f715-425a-946d-40939a0e6371 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:16.952191 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=74 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:16.961073 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-7de923fa-f715-425a-946d-40939a0e6371 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1522 microversion: 2.1 time: 0.198872 May 23 17:19:16.962260 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 88/170] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:16 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:17.982012 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ddb0c1eb-6f54-4bdf-8083-bb1dd93a903c tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:17.982699 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ddb0c1eb-6f54-4bdf-8083-bb1dd93a903c tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:17.989031 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ddb0c1eb-6f54-4bdf-8083-bb1dd93a903c tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:17.989424 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ddb0c1eb-6f54-4bdf-8083-bb1dd93a903c tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:17.990171 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ddb0c1eb-6f54-4bdf-8083-bb1dd93a903c tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:17.990604 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ddb0c1eb-6f54-4bdf-8083-bb1dd93a903c tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:18.135646 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ddb0c1eb-6f54-4bdf-8083-bb1dd93a903c tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:18.155545 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ddb0c1eb-6f54-4bdf-8083-bb1dd93a903c tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1522 microversion: 2.1 time: 0.173702 May 23 17:19:18.157636 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 83/171] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:17 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:19.175551 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d67a1396-62f5-4424-97d7-eaaefe474e4b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:19.176199 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d67a1396-62f5-4424-97d7-eaaefe474e4b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:19.183589 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d67a1396-62f5-4424-97d7-eaaefe474e4b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:19.186123 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d67a1396-62f5-4424-97d7-eaaefe474e4b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:19.186994 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d67a1396-62f5-4424-97d7-eaaefe474e4b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:19.187447 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d67a1396-62f5-4424-97d7-eaaefe474e4b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:19.383944 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d67a1396-62f5-4424-97d7-eaaefe474e4b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:19.397905 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d67a1396-62f5-4424-97d7-eaaefe474e4b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1502 microversion: 2.1 time: 0.226887 May 23 17:19:19.398878 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 89/172] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:19 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1502 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:19:19.414625 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-88252fae-9989-4c16-95f5-cb5f18b04838 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:19.415187 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-88252fae-9989-4c16-95f5-cb5f18b04838 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: e7b61ab9-ad21-427d-a451-1f721fb3a84c] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:19.421676 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-88252fae-9989-4c16-95f5-cb5f18b04838 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:19.422384 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-88252fae-9989-4c16-95f5-cb5f18b04838 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:19.423372 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-88252fae-9989-4c16-95f5-cb5f18b04838 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:19.423947 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-88252fae-9989-4c16-95f5-cb5f18b04838 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:19.588091 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-88252fae-9989-4c16-95f5-cb5f18b04838 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:19.598346 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-88252fae-9989-4c16-95f5-cb5f18b04838 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c" status: 200 len: 1516 microversion: 2.1 time: 0.187714 May 23 17:19:19.599298 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 84/173] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:19 2022] GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c => generated 1516 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:23.256209 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-df12d58d-597f-49e9-8baf-c3c1b22b938d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:19:23.257426 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-df12d58d-597f-49e9-8baf-c3c1b22b938d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: e7b61ab9-ad21-427d-a451-1f721fb3a84c] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:23.260618 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=4 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:23.266971 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-df12d58d-597f-49e9-8baf-c3c1b22b938d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:23.267485 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-df12d58d-597f-49e9-8baf-c3c1b22b938d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:23.268327 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-df12d58d-597f-49e9-8baf-c3c1b22b938d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:23.268793 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-df12d58d-597f-49e9-8baf-c3c1b22b938d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:23.295598 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.objects.instance [None req-df12d58d-597f-49e9-8baf-c3c1b22b938d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lazy-loading 'flavor' on Instance uuid e7b61ab9-ad21-427d-a451-1f721fb3a84c {{(pid=117910) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 17:19:23.297324 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0a3d3b91-5b94-404a-88fb-367e016a064f tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2100165445", "imageRef": "99870172-61a4-4218-9407-6a6da3fb5c83", "flavorRef": "452", "networks": [{"uuid": "0cf25c9b-22b7-4ee3-b051-3ed242490f5b"}]}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:19:23.371821 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.network.neutron [None req-0a3d3b91-5b94-404a-88fb-367e016a064f tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] validate_networks() for [('0cf25c9b-22b7-4ee3-b051-3ed242490f5b', None, None, None, None, None)] {{(pid=117909) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 17:19:23.432147 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-df12d58d-597f-49e9-8baf-c3c1b22b938d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "POST /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c/action" status: 200 len: 32 microversion: 2.1 time: 0.180400 May 23 17:19:23.433039 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 90/174] 10.222.0.46 () {60 vars in 1277 bytes} [Mon May 23 17:19:23 2022] POST /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c/action => generated 32 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 17:19:23.444515 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-1f084381-cad5-45bb-858e-322a7c848efe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:23.445356 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-1f084381-cad5-45bb-858e-322a7c848efe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: e7b61ab9-ad21-427d-a451-1f721fb3a84c] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:23.455701 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1f084381-cad5-45bb-858e-322a7c848efe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:23.456360 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1f084381-cad5-45bb-858e-322a7c848efe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:23.457367 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1f084381-cad5-45bb-858e-322a7c848efe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:23.457944 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1f084381-cad5-45bb-858e-322a7c848efe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:23.752275 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-1f084381-cad5-45bb-858e-322a7c848efe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:23.760153 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-1f084381-cad5-45bb-858e-322a7c848efe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c" status: 200 len: 1522 microversion: 2.1 time: 0.321398 May 23 17:19:23.760896 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 91/175] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:23 2022] GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c => generated 1522 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:19:24.067390 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-0a3d3b91-5b94-404a-88fb-367e016a064f tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Flavor limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 17:19:24.067724 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-0a3d3b91-5b94-404a-88fb-367e016a064f tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Image limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 17:19:24.068186 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-0a3d3b91-5b94-404a-88fb-367e016a064f tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Flavor pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 17:19:24.068877 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-0a3d3b91-5b94-404a-88fb-367e016a064f tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Image pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 17:19:24.069461 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-0a3d3b91-5b94-404a-88fb-367e016a064f tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 17:19:24.082156 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0a3d3b91-5b94-404a-88fb-367e016a064f tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:24.082925 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0a3d3b91-5b94-404a-88fb-367e016a064f tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:24.090643 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0a3d3b91-5b94-404a-88fb-367e016a064f tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:24.090643 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0a3d3b91-5b94-404a-88fb-367e016a064f tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:24.114122 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-0a3d3b91-5b94-404a-88fb-367e016a064f tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Getting quotas for project 31c15be59539430b9f25b8236c4d03c7. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 17:19:24.119002 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-0a3d3b91-5b94-404a-88fb-367e016a064f tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Getting quotas for user b88d284f57a44ddcb0f1347942a2950b and project 31c15be59539430b9f25b8236c4d03c7. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 17:19:24.133263 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0a3d3b91-5b94-404a-88fb-367e016a064f tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Going to run 1 instances... {{(pid=117909) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 17:19:24.135726 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0a3d3b91-5b94-404a-88fb-367e016a064f tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: 3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99870172-61a4-4218-9407-6a6da3fb5c83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 17:19:24.212861 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0a3d3b91-5b94-404a-88fb-367e016a064f tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.919286 May 23 17:19:24.214223 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 85/176] 10.222.0.46 () {60 vars in 1146 bytes} [Mon May 23 17:19:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 23 17:19:24.226742 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-ec243151-3fc2-409b-9783-8298e086e1ad tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:24.227590 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-ec243151-3fc2-409b-9783-8298e086e1ad tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: 3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:24.323908 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ec243151-3fc2-409b-9783-8298e086e1ad tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:24.332417 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-ec243151-3fc2-409b-9783-8298e086e1ad tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8" status: 200 len: 1214 microversion: 2.1 time: 0.110252 May 23 17:19:24.333030 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 92/177] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:24 2022] GET /compute/v2.1/servers/3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8 => generated 1214 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:19:24.779396 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4b5105d1-a2dc-42ee-961c-d587c7b94abd tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:24.781054 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4b5105d1-a2dc-42ee-961c-d587c7b94abd tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: e7b61ab9-ad21-427d-a451-1f721fb3a84c] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:24.801955 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4b5105d1-a2dc-42ee-961c-d587c7b94abd tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:24.803364 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4b5105d1-a2dc-42ee-961c-d587c7b94abd tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:24.804873 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4b5105d1-a2dc-42ee-961c-d587c7b94abd tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:24.805558 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4b5105d1-a2dc-42ee-961c-d587c7b94abd tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:24.996074 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4b5105d1-a2dc-42ee-961c-d587c7b94abd tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:25.007994 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4b5105d1-a2dc-42ee-961c-d587c7b94abd tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c" status: 200 len: 1522 microversion: 2.1 time: 0.234139 May 23 17:19:25.009432 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 86/178] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:24 2022] GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:25.351458 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-9551a757-6d08-4c92-96d8-efde288fc0ef tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:25.352042 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-9551a757-6d08-4c92-96d8-efde288fc0ef tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: 3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:25.360829 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9551a757-6d08-4c92-96d8-efde288fc0ef tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:25.361573 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9551a757-6d08-4c92-96d8-efde288fc0ef tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:25.362357 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9551a757-6d08-4c92-96d8-efde288fc0ef tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:25.366298 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9551a757-6d08-4c92-96d8-efde288fc0ef tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:25.448185 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9551a757-6d08-4c92-96d8-efde288fc0ef tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:25.456142 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-9551a757-6d08-4c92-96d8-efde288fc0ef tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8" status: 200 len: 1218 microversion: 2.1 time: 0.110266 May 23 17:19:25.456757 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 93/179] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:25 2022] GET /compute/v2.1/servers/3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8 => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:26.027453 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-772bf6dc-4727-4358-9a5c-aaf6d4779c00 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:26.028853 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-772bf6dc-4727-4358-9a5c-aaf6d4779c00 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: e7b61ab9-ad21-427d-a451-1f721fb3a84c] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:26.037200 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-772bf6dc-4727-4358-9a5c-aaf6d4779c00 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:26.037952 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-772bf6dc-4727-4358-9a5c-aaf6d4779c00 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:26.039107 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-772bf6dc-4727-4358-9a5c-aaf6d4779c00 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:26.039821 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-772bf6dc-4727-4358-9a5c-aaf6d4779c00 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:26.221644 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-772bf6dc-4727-4358-9a5c-aaf6d4779c00 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:26.230035 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-772bf6dc-4727-4358-9a5c-aaf6d4779c00 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c" status: 200 len: 1522 microversion: 2.1 time: 0.207456 May 23 17:19:26.230626 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 87/180] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:26 2022] GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:26.476022 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-956a15b2-60f5-46b0-8449-34ae27529264 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:26.477301 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-956a15b2-60f5-46b0-8449-34ae27529264 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: 3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:26.486390 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-956a15b2-60f5-46b0-8449-34ae27529264 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:26.487575 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-956a15b2-60f5-46b0-8449-34ae27529264 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:26.488756 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-956a15b2-60f5-46b0-8449-34ae27529264 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:26.489653 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-956a15b2-60f5-46b0-8449-34ae27529264 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:26.603705 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-956a15b2-60f5-46b0-8449-34ae27529264 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:26.612655 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-956a15b2-60f5-46b0-8449-34ae27529264 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8" status: 200 len: 1218 microversion: 2.1 time: 0.142770 May 23 17:19:26.616529 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 94/181] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:26 2022] GET /compute/v2.1/servers/3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8 => generated 1218 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:27.252978 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-428adbec-89f9-4a3e-b030-ba1de12c5516 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:27.254214 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-428adbec-89f9-4a3e-b030-ba1de12c5516 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: e7b61ab9-ad21-427d-a451-1f721fb3a84c] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:27.261588 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-428adbec-89f9-4a3e-b030-ba1de12c5516 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:27.262243 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-428adbec-89f9-4a3e-b030-ba1de12c5516 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:27.263584 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-428adbec-89f9-4a3e-b030-ba1de12c5516 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:27.264174 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-428adbec-89f9-4a3e-b030-ba1de12c5516 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:27.542275 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-428adbec-89f9-4a3e-b030-ba1de12c5516 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:27.553078 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-428adbec-89f9-4a3e-b030-ba1de12c5516 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c" status: 200 len: 1522 microversion: 2.1 time: 0.303226 May 23 17:19:27.557271 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 88/182] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:27 2022] GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:27.633536 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-13757942-4e52-47a8-a5c4-ea935080c53f tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:27.635233 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-13757942-4e52-47a8-a5c4-ea935080c53f tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: 3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:27.644442 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-13757942-4e52-47a8-a5c4-ea935080c53f tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:27.645264 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-13757942-4e52-47a8-a5c4-ea935080c53f tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:27.648409 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-13757942-4e52-47a8-a5c4-ea935080c53f tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:27.649493 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-13757942-4e52-47a8-a5c4-ea935080c53f tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:27.757215 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-13757942-4e52-47a8-a5c4-ea935080c53f tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:27.772391 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-13757942-4e52-47a8-a5c4-ea935080c53f tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8" status: 200 len: 1218 microversion: 2.1 time: 0.141808 May 23 17:19:27.778073 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 95/183] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:27 2022] GET /compute/v2.1/servers/3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8 => generated 1218 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:28.574629 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7ed8702f-30d9-4135-a040-8aa4e9e0e21c tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:28.575265 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7ed8702f-30d9-4135-a040-8aa4e9e0e21c tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: e7b61ab9-ad21-427d-a451-1f721fb3a84c] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:28.581986 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7ed8702f-30d9-4135-a040-8aa4e9e0e21c tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:28.582416 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7ed8702f-30d9-4135-a040-8aa4e9e0e21c tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:28.583434 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7ed8702f-30d9-4135-a040-8aa4e9e0e21c tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:28.583864 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7ed8702f-30d9-4135-a040-8aa4e9e0e21c tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:28.802358 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-10091b7d-9b2d-4649-a6a0-da6484a12c16 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:28.803941 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-10091b7d-9b2d-4649-a6a0-da6484a12c16 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: 3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:28.818371 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7ed8702f-30d9-4135-a040-8aa4e9e0e21c tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:28.824940 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-10091b7d-9b2d-4649-a6a0-da6484a12c16 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:28.826422 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-10091b7d-9b2d-4649-a6a0-da6484a12c16 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:28.828582 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7ed8702f-30d9-4135-a040-8aa4e9e0e21c tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c" status: 200 len: 1522 microversion: 2.1 time: 0.260343 May 23 17:19:28.835868 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 89/184] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:28 2022] GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:28.837248 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-10091b7d-9b2d-4649-a6a0-da6484a12c16 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:28.837991 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-10091b7d-9b2d-4649-a6a0-da6484a12c16 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:28.949850 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-10091b7d-9b2d-4649-a6a0-da6484a12c16 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:28.968916 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-10091b7d-9b2d-4649-a6a0-da6484a12c16 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8" status: 200 len: 1266 microversion: 2.1 time: 0.181744 May 23 17:19:28.983714 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 96/185] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:28 2022] GET /compute/v2.1/servers/3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:29.847412 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-17e4da69-68de-46e5-821b-e0f1a5fe08f2 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:29.848837 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-17e4da69-68de-46e5-821b-e0f1a5fe08f2 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: e7b61ab9-ad21-427d-a451-1f721fb3a84c] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:29.856074 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-17e4da69-68de-46e5-821b-e0f1a5fe08f2 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:29.856757 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-17e4da69-68de-46e5-821b-e0f1a5fe08f2 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:29.858387 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-17e4da69-68de-46e5-821b-e0f1a5fe08f2 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:29.858994 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-17e4da69-68de-46e5-821b-e0f1a5fe08f2 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:29.989236 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-f3b9c1a7-578c-4ae2-9057-42cc92bd55d3 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:29.991128 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-f3b9c1a7-578c-4ae2-9057-42cc92bd55d3 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: 3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:30.002046 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f3b9c1a7-578c-4ae2-9057-42cc92bd55d3 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:30.002909 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f3b9c1a7-578c-4ae2-9057-42cc92bd55d3 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:30.004070 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f3b9c1a7-578c-4ae2-9057-42cc92bd55d3 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:30.005051 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f3b9c1a7-578c-4ae2-9057-42cc92bd55d3 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:30.169276 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-17e4da69-68de-46e5-821b-e0f1a5fe08f2 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:30.178180 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-17e4da69-68de-46e5-821b-e0f1a5fe08f2 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c" status: 200 len: 1522 microversion: 2.1 time: 0.336525 May 23 17:19:30.178770 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 90/186] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:29 2022] GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c => generated 1522 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:30.260199 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-f3b9c1a7-578c-4ae2-9057-42cc92bd55d3 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:30.269441 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-f3b9c1a7-578c-4ae2-9057-42cc92bd55d3 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8" status: 200 len: 1314 microversion: 2.1 time: 0.285939 May 23 17:19:30.270059 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 97/187] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:29 2022] GET /compute/v2.1/servers/3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:31.196072 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f45f58ea-ba36-47ff-8279-76a08ff8c79b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:31.196707 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f45f58ea-ba36-47ff-8279-76a08ff8c79b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: e7b61ab9-ad21-427d-a451-1f721fb3a84c] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:31.208337 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f45f58ea-ba36-47ff-8279-76a08ff8c79b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:31.208913 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f45f58ea-ba36-47ff-8279-76a08ff8c79b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:31.209658 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f45f58ea-ba36-47ff-8279-76a08ff8c79b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:31.210085 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f45f58ea-ba36-47ff-8279-76a08ff8c79b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:31.288075 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-36b97eff-5c79-4061-9604-9874c2961362 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:31.289918 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-36b97eff-5c79-4061-9604-9874c2961362 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: 3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:31.309202 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-36b97eff-5c79-4061-9604-9874c2961362 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:31.312782 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-36b97eff-5c79-4061-9604-9874c2961362 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:31.317692 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-36b97eff-5c79-4061-9604-9874c2961362 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:31.319361 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-36b97eff-5c79-4061-9604-9874c2961362 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:31.895930 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f45f58ea-ba36-47ff-8279-76a08ff8c79b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:31.899991 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-36b97eff-5c79-4061-9604-9874c2961362 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:31.911511 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f45f58ea-ba36-47ff-8279-76a08ff8c79b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c" status: 200 len: 1522 microversion: 2.1 time: 0.719162 May 23 17:19:31.911770 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-36b97eff-5c79-4061-9604-9874c2961362 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8" status: 200 len: 1314 microversion: 2.1 time: 0.628072 May 23 17:19:31.912864 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 98/189] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:31 2022] GET /compute/v2.1/servers/3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8 => generated 1314 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:31.912990 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 91/189] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:31 2022] GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c => generated 1522 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:31.918101 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-48313cda-f13f-41a2-8ad4-b5aa4a73dff9 req-bd5a3934-1fa8-46b9-9296-644f4f2dcbb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8", "tag": "505ddb52-e6c9-4358-b5b3-4888f0d9d834"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:19:31.928254 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-48313cda-f13f-41a2-8ad4-b5aa4a73dff9 req-bd5a3934-1fa8-46b9-9296-644f4f2dcbb4 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:31.928739 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-48313cda-f13f-41a2-8ad4-b5aa4a73dff9 req-bd5a3934-1fa8-46b9-9296-644f4f2dcbb4 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:31.945983 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-48313cda-f13f-41a2-8ad4-b5aa4a73dff9 req-bd5a3934-1fa8-46b9-9296-644f4f2dcbb4 service nova] Creating event network-changed:505ddb52-e6c9-4358-b5b3-4888f0d9d834 for instance 3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8 on hv-cinder-84299 May 23 17:19:31.954481 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-48313cda-f13f-41a2-8ad4-b5aa4a73dff9 req-bd5a3934-1fa8-46b9-9296-644f4f2dcbb4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040129 May 23 17:19:31.956178 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 92/190] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:19:32.929616 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2d73595a-8a13-4bef-9cfd-10a02481ba62 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:32.930231 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2d73595a-8a13-4bef-9cfd-10a02481ba62 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: 3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:32.931552 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e8c834ea-a881-4a8f-8fa7-8c65f94b666d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:32.932531 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e8c834ea-a881-4a8f-8fa7-8c65f94b666d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: e7b61ab9-ad21-427d-a451-1f721fb3a84c] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:32.947404 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e8c834ea-a881-4a8f-8fa7-8c65f94b666d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:32.948554 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e8c834ea-a881-4a8f-8fa7-8c65f94b666d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:32.951918 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e8c834ea-a881-4a8f-8fa7-8c65f94b666d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:32.952227 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2d73595a-8a13-4bef-9cfd-10a02481ba62 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:32.952357 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e8c834ea-a881-4a8f-8fa7-8c65f94b666d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:32.954259 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2d73595a-8a13-4bef-9cfd-10a02481ba62 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:32.955053 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2d73595a-8a13-4bef-9cfd-10a02481ba62 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:32.958528 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2d73595a-8a13-4bef-9cfd-10a02481ba62 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:33.413884 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e8c834ea-a881-4a8f-8fa7-8c65f94b666d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:33.431373 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e8c834ea-a881-4a8f-8fa7-8c65f94b666d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c" status: 200 len: 1522 microversion: 2.1 time: 0.505512 May 23 17:19:33.434080 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 93/191] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:32 2022] GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c => generated 1522 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:19:33.448567 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2d73595a-8a13-4bef-9cfd-10a02481ba62 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:33.467010 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2d73595a-8a13-4bef-9cfd-10a02481ba62 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8" status: 200 len: 1314 microversion: 2.1 time: 0.538861 May 23 17:19:33.469922 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 99/192] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:32 2022] GET /compute/v2.1/servers/3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8 => generated 1314 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:34.450817 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b1d84615-53c7-4e65-b235-38ae753ec5f6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:34.451988 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b1d84615-53c7-4e65-b235-38ae753ec5f6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: e7b61ab9-ad21-427d-a451-1f721fb3a84c] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:34.459272 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=2 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:34.460385 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=6 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:34.463143 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b1d84615-53c7-4e65-b235-38ae753ec5f6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:34.463887 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b1d84615-53c7-4e65-b235-38ae753ec5f6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:34.465746 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b1d84615-53c7-4e65-b235-38ae753ec5f6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:34.467113 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b1d84615-53c7-4e65-b235-38ae753ec5f6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:34.483644 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-26cc9ae9-0eb8-47a3-a76f-093a34170b7c tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:34.484877 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-26cc9ae9-0eb8-47a3-a76f-093a34170b7c tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: 3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:34.494557 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=2 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:34.500639 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-26cc9ae9-0eb8-47a3-a76f-093a34170b7c tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:34.502970 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-26cc9ae9-0eb8-47a3-a76f-093a34170b7c tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:34.503792 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-26cc9ae9-0eb8-47a3-a76f-093a34170b7c tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:34.508914 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-26cc9ae9-0eb8-47a3-a76f-093a34170b7c tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:34.871586 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-26cc9ae9-0eb8-47a3-a76f-093a34170b7c tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:34.888905 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-26cc9ae9-0eb8-47a3-a76f-093a34170b7c tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8" status: 200 len: 1314 microversion: 2.1 time: 0.408603 May 23 17:19:34.889837 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 100/193] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:34 2022] GET /compute/v2.1/servers/3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8 => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:19:34.926107 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b1d84615-53c7-4e65-b235-38ae753ec5f6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:34.935428 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b1d84615-53c7-4e65-b235-38ae753ec5f6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c" status: 200 len: 1522 microversion: 2.1 time: 0.489191 May 23 17:19:34.941392 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 94/194] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:34 2022] GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c => generated 1522 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:35.914696 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-3d51f30f-aed2-4c5d-b640-b76d176c49f8 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:35.915504 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-3d51f30f-aed2-4c5d-b640-b76d176c49f8 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: 3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:35.934246 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3d51f30f-aed2-4c5d-b640-b76d176c49f8 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:35.936749 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3d51f30f-aed2-4c5d-b640-b76d176c49f8 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:35.938538 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3d51f30f-aed2-4c5d-b640-b76d176c49f8 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:35.941798 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3d51f30f-aed2-4c5d-b640-b76d176c49f8 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:35.961616 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-33705096-03bb-448b-882d-28e9f7b7df66 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:35.963442 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-33705096-03bb-448b-882d-28e9f7b7df66 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: e7b61ab9-ad21-427d-a451-1f721fb3a84c] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:35.977901 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-33705096-03bb-448b-882d-28e9f7b7df66 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:35.982581 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-33705096-03bb-448b-882d-28e9f7b7df66 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:35.983657 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-33705096-03bb-448b-882d-28e9f7b7df66 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:35.986838 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-33705096-03bb-448b-882d-28e9f7b7df66 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:36.378416 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-33705096-03bb-448b-882d-28e9f7b7df66 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:36.389944 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-33705096-03bb-448b-882d-28e9f7b7df66 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c" status: 200 len: 1522 microversion: 2.1 time: 0.436526 May 23 17:19:36.390542 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 95/195] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:35 2022] GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c => generated 1522 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:19:36.412294 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-3d51f30f-aed2-4c5d-b640-b76d176c49f8 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:36.441144 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-3d51f30f-aed2-4c5d-b640-b76d176c49f8 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8" status: 200 len: 1314 microversion: 2.1 time: 0.536939 May 23 17:19:36.459286 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 101/196] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:35 2022] GET /compute/v2.1/servers/3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8 => generated 1314 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:37.407433 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-28cd698b-e74c-4a3d-b1c3-42d7d28095fe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:37.408716 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-28cd698b-e74c-4a3d-b1c3-42d7d28095fe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: e7b61ab9-ad21-427d-a451-1f721fb3a84c] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:37.418855 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-28cd698b-e74c-4a3d-b1c3-42d7d28095fe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:37.419312 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-28cd698b-e74c-4a3d-b1c3-42d7d28095fe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:37.421888 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-28cd698b-e74c-4a3d-b1c3-42d7d28095fe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:37.424227 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-28cd698b-e74c-4a3d-b1c3-42d7d28095fe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:37.473911 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-94892074-b35d-46e9-a67f-38abc69eb314 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:37.475084 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-94892074-b35d-46e9-a67f-38abc69eb314 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: 3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:37.488492 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-94892074-b35d-46e9-a67f-38abc69eb314 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:37.491084 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-94892074-b35d-46e9-a67f-38abc69eb314 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:37.492924 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-94892074-b35d-46e9-a67f-38abc69eb314 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:37.496770 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-94892074-b35d-46e9-a67f-38abc69eb314 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:37.850157 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-28cd698b-e74c-4a3d-b1c3-42d7d28095fe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:37.864930 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-28cd698b-e74c-4a3d-b1c3-42d7d28095fe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c" status: 200 len: 1522 microversion: 2.1 time: 0.458909 May 23 17:19:37.867504 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 96/197] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:37 2022] GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c => generated 1522 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:37.955612 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-94892074-b35d-46e9-a67f-38abc69eb314 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:37.967216 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-94892074-b35d-46e9-a67f-38abc69eb314 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8" status: 200 len: 1314 microversion: 2.1 time: 0.494059 May 23 17:19:37.968306 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 102/198] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:37 2022] GET /compute/v2.1/servers/3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8 => generated 1314 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:19:38.884126 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-26335d86-3afa-4218-ab14-cfd9276f8612 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:38.884823 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-26335d86-3afa-4218-ab14-cfd9276f8612 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: e7b61ab9-ad21-427d-a451-1f721fb3a84c] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:38.891823 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-26335d86-3afa-4218-ab14-cfd9276f8612 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:38.892271 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-26335d86-3afa-4218-ab14-cfd9276f8612 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:38.893079 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-26335d86-3afa-4218-ab14-cfd9276f8612 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:38.893849 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-26335d86-3afa-4218-ab14-cfd9276f8612 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:38.985959 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-84da4b20-24a4-417d-b6ab-809398c23d80 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:38.987511 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-84da4b20-24a4-417d-b6ab-809398c23d80 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: 3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:38.996625 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-84da4b20-24a4-417d-b6ab-809398c23d80 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:38.997079 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-84da4b20-24a4-417d-b6ab-809398c23d80 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:38.997934 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-84da4b20-24a4-417d-b6ab-809398c23d80 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:38.998362 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-84da4b20-24a4-417d-b6ab-809398c23d80 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:39.063361 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-26335d86-3afa-4218-ab14-cfd9276f8612 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:39.072630 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-26335d86-3afa-4218-ab14-cfd9276f8612 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c" status: 200 len: 1522 microversion: 2.1 time: 0.193205 May 23 17:19:39.076707 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 97/199] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:38 2022] GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:39.196195 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-84da4b20-24a4-417d-b6ab-809398c23d80 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:39.208484 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-84da4b20-24a4-417d-b6ab-809398c23d80 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8" status: 200 len: 1314 microversion: 2.1 time: 0.226499 May 23 17:19:39.219714 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 103/200] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:38 2022] GET /compute/v2.1/servers/3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:40.094009 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8d61faf0-e613-4cc4-a42c-1ad35f099980 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:40.094736 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8d61faf0-e613-4cc4-a42c-1ad35f099980 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: e7b61ab9-ad21-427d-a451-1f721fb3a84c] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:40.105300 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8d61faf0-e613-4cc4-a42c-1ad35f099980 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:40.105744 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8d61faf0-e613-4cc4-a42c-1ad35f099980 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:40.106515 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8d61faf0-e613-4cc4-a42c-1ad35f099980 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:40.106989 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8d61faf0-e613-4cc4-a42c-1ad35f099980 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:40.227288 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c19ffb08-cbb4-4d5a-8fcd-43043cf70592 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:40.227902 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c19ffb08-cbb4-4d5a-8fcd-43043cf70592 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: 3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:40.238265 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c19ffb08-cbb4-4d5a-8fcd-43043cf70592 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:40.238986 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c19ffb08-cbb4-4d5a-8fcd-43043cf70592 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:40.239920 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c19ffb08-cbb4-4d5a-8fcd-43043cf70592 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:40.241063 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c19ffb08-cbb4-4d5a-8fcd-43043cf70592 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:40.263360 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:40.508876 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8d61faf0-e613-4cc4-a42c-1ad35f099980 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:40.517822 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8d61faf0-e613-4cc4-a42c-1ad35f099980 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c" status: 200 len: 1522 microversion: 2.1 time: 0.428713 May 23 17:19:40.522462 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 98/201] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:40 2022] GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c => generated 1522 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:40.536588 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-31849698-44e2-41ef-a0d7-26c31ed72906 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1878195404", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-423638123", "security_groups": [{"name": "tempest-secgroup-smoke-59473231"}], "block_device_mapping_v2": [{"uuid": "b1fab6af-c334-42e7-972b-753c6adeff09", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "53cf278b-29c3-4094-b45f-c66c3ecb5db2"}]}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:19:40.572877 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-c19ffb08-cbb4-4d5a-8fcd-43043cf70592 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:40.582512 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c19ffb08-cbb4-4d5a-8fcd-43043cf70592 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8" status: 200 len: 1314 microversion: 2.1 time: 0.359029 May 23 17:19:40.584166 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 104/202] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:40 2022] GET /compute/v2.1/servers/3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8 => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:19:40.731541 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.network.neutron [None req-31849698-44e2-41ef-a0d7-26c31ed72906 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] validate_networks() for [('53cf278b-29c3-4094-b45f-c66c3ecb5db2', None, None, None, None, None)] {{(pid=117909) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 17:19:40.841055 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-36083219-e151-4891-af83-9cd529d2d5db req-faf50641-d147-4b9d-b86c-4db11ce0059a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8", "name": "network-vif-plugged", "status": "completed", "tag": "505ddb52-e6c9-4358-b5b3-4888f0d9d834"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:19:40.857454 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-36083219-e151-4891-af83-9cd529d2d5db req-faf50641-d147-4b9d-b86c-4db11ce0059a service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:40.862768 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-36083219-e151-4891-af83-9cd529d2d5db req-faf50641-d147-4b9d-b86c-4db11ce0059a service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:40.913720 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-36083219-e151-4891-af83-9cd529d2d5db req-faf50641-d147-4b9d-b86c-4db11ce0059a service nova] Creating event network-vif-plugged:505ddb52-e6c9-4358-b5b3-4888f0d9d834 for instance 3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8 on hv-cinder-84299 May 23 17:19:40.937658 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-36083219-e151-4891-af83-9cd529d2d5db req-faf50641-d147-4b9d-b86c-4db11ce0059a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096925 May 23 17:19:40.939778 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 105/203] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 17:19:41.542783 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-0b6c210f-a29c-4c16-b57e-2fb9bc7daf80 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:41.544174 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-0b6c210f-a29c-4c16-b57e-2fb9bc7daf80 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: e7b61ab9-ad21-427d-a451-1f721fb3a84c] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:41.558775 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0b6c210f-a29c-4c16-b57e-2fb9bc7daf80 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:41.560501 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0b6c210f-a29c-4c16-b57e-2fb9bc7daf80 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:41.562319 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0b6c210f-a29c-4c16-b57e-2fb9bc7daf80 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:41.564119 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0b6c210f-a29c-4c16-b57e-2fb9bc7daf80 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:41.577760 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-31849698-44e2-41ef-a0d7-26c31ed72906 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Flavor limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 17:19:41.579721 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-31849698-44e2-41ef-a0d7-26c31ed72906 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Image limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 17:19:41.580364 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-31849698-44e2-41ef-a0d7-26c31ed72906 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Flavor pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 17:19:41.581344 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-31849698-44e2-41ef-a0d7-26c31ed72906 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Image pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 17:19:41.584704 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-31849698-44e2-41ef-a0d7-26c31ed72906 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 17:19:41.606818 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-31849698-44e2-41ef-a0d7-26c31ed72906 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:41.607836 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-31849698-44e2-41ef-a0d7-26c31ed72906 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:41.609671 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-31849698-44e2-41ef-a0d7-26c31ed72906 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:41.610873 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-31849698-44e2-41ef-a0d7-26c31ed72906 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:41.630565 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:41.665221 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-31849698-44e2-41ef-a0d7-26c31ed72906 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Getting quotas for project df984bae4f4e4d01ac06870bee8a73bf. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 17:19:41.672239 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-31849698-44e2-41ef-a0d7-26c31ed72906 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Getting quotas for user dc9c9dd337834dea821cc4ea6ecc10a6 and project df984bae4f4e4d01ac06870bee8a73bf. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 17:19:41.865224 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-31849698-44e2-41ef-a0d7-26c31ed72906 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Going to run 1 instances... {{(pid=117909) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 17:19:41.870162 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-31849698-44e2-41ef-a0d7-26c31ed72906 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2391a78f-53ee-4e0f-b59f-5978e3ee93a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b1fab6af-c334-42e7-972b-753c6adeff09',volume_size=None,volume_type=None)] {{(pid=117909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 17:19:41.907340 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-0b6c210f-a29c-4c16-b57e-2fb9bc7daf80 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:41.918820 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-0b6c210f-a29c-4c16-b57e-2fb9bc7daf80 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c" status: 200 len: 1522 microversion: 2.1 time: 0.382744 May 23 17:19:41.929764 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 106/204] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:41 2022] GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c => generated 1522 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:41.937018 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-06ac735d-845f-41db-a72f-b70c87281b4d tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:41.937792 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-06ac735d-845f-41db-a72f-b70c87281b4d tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: 3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:41.945233 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-06ac735d-845f-41db-a72f-b70c87281b4d tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:41.945859 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-06ac735d-845f-41db-a72f-b70c87281b4d tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:41.947218 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-06ac735d-845f-41db-a72f-b70c87281b4d tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:41.947813 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-06ac735d-845f-41db-a72f-b70c87281b4d tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:42.211976 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-06ac735d-845f-41db-a72f-b70c87281b4d tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:42.222625 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-06ac735d-845f-41db-a72f-b70c87281b4d tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8" status: 200 len: 1314 microversion: 2.1 time: 0.298170 May 23 17:19:42.223912 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 107/205] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:41 2022] GET /compute/v2.1/servers/3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8 => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:42.238299 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:42.344392 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-31849698-44e2-41ef-a0d7-26c31ed72906 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.814509 May 23 17:19:42.352926 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 99/206] 10.222.0.46 () {60 vars in 1146 bytes} [Mon May 23 17:19:40 2022] POST /compute/v2.1/servers => generated 404 bytes in 1825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 17:19:42.357731 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-966e59c5-7e7a-4369-9491-cf5e8a2dacfe tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:42.358489 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-966e59c5-7e7a-4369-9491-cf5e8a2dacfe tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2391a78f-53ee-4e0f-b59f-5978e3ee93a0] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:42.435157 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-966e59c5-7e7a-4369-9491-cf5e8a2dacfe tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:42.444257 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-966e59c5-7e7a-4369-9491-cf5e8a2dacfe tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0" status: 200 len: 1094 microversion: 2.1 time: 0.090868 May 23 17:19:42.445263 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 108/207] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:42 2022] GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0 => generated 1094 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:42.943766 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f9156a36-13d2-4b2a-8f72-730703e0ae7c tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:42.943766 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f9156a36-13d2-4b2a-8f72-730703e0ae7c tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: e7b61ab9-ad21-427d-a451-1f721fb3a84c] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:42.984406 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f9156a36-13d2-4b2a-8f72-730703e0ae7c tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:42.987380 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f9156a36-13d2-4b2a-8f72-730703e0ae7c tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:42.988726 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f9156a36-13d2-4b2a-8f72-730703e0ae7c tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:42.990346 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f9156a36-13d2-4b2a-8f72-730703e0ae7c tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:43.245284 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-367908ea-a2f0-437c-8936-92ac8f484eb5 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:43.246058 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-367908ea-a2f0-437c-8936-92ac8f484eb5 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: 3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:43.248978 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:43.285824 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-367908ea-a2f0-437c-8936-92ac8f484eb5 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:43.292953 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-367908ea-a2f0-437c-8936-92ac8f484eb5 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:43.293813 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-367908ea-a2f0-437c-8936-92ac8f484eb5 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:43.300702 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-367908ea-a2f0-437c-8936-92ac8f484eb5 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:43.555689 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f9156a36-13d2-4b2a-8f72-730703e0ae7c tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:43.567270 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f9156a36-13d2-4b2a-8f72-730703e0ae7c tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c" status: 200 len: 1522 microversion: 2.1 time: 0.633922 May 23 17:19:43.568866 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 100/208] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:42 2022] GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c => generated 1522 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:43.583353 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4354b190-9eb3-42e2-ac1e-9b251f8a91ca tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:43.587807 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4354b190-9eb3-42e2-ac1e-9b251f8a91ca tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2391a78f-53ee-4e0f-b59f-5978e3ee93a0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:43.607015 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4354b190-9eb3-42e2-ac1e-9b251f8a91ca tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:43.608355 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4354b190-9eb3-42e2-ac1e-9b251f8a91ca tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:43.609999 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4354b190-9eb3-42e2-ac1e-9b251f8a91ca tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:43.613769 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4354b190-9eb3-42e2-ac1e-9b251f8a91ca tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:43.743017 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-367908ea-a2f0-437c-8936-92ac8f484eb5 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:43.759098 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-367908ea-a2f0-437c-8936-92ac8f484eb5 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8" status: 200 len: 1314 microversion: 2.1 time: 0.521056 May 23 17:19:43.775969 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 109/209] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:43 2022] GET /compute/v2.1/servers/3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8 => generated 1314 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:43.854765 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4354b190-9eb3-42e2-ac1e-9b251f8a91ca tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:43.864016 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4354b190-9eb3-42e2-ac1e-9b251f8a91ca tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0" status: 200 len: 1136 microversion: 2.1 time: 0.294037 May 23 17:19:43.868651 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 101/210] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:43 2022] GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0 => generated 1136 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:44.585554 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-55a3ed34-1504-4cac-8f8f-d0690960ff11 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:44.586913 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-55a3ed34-1504-4cac-8f8f-d0690960ff11 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: e7b61ab9-ad21-427d-a451-1f721fb3a84c] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:44.614710 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-55a3ed34-1504-4cac-8f8f-d0690960ff11 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:44.615749 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-55a3ed34-1504-4cac-8f8f-d0690960ff11 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:44.617061 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-55a3ed34-1504-4cac-8f8f-d0690960ff11 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:44.617668 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-55a3ed34-1504-4cac-8f8f-d0690960ff11 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:44.781141 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e830ef5b-f9d3-4e1c-98d7-39737debd311 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:44.781773 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e830ef5b-f9d3-4e1c-98d7-39737debd311 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: 3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:44.790926 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e830ef5b-f9d3-4e1c-98d7-39737debd311 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:44.791295 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e830ef5b-f9d3-4e1c-98d7-39737debd311 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:44.792085 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e830ef5b-f9d3-4e1c-98d7-39737debd311 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:44.792530 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e830ef5b-f9d3-4e1c-98d7-39737debd311 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:44.896559 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-55a3ed34-1504-4cac-8f8f-d0690960ff11 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:44.908204 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-55a3ed34-1504-4cac-8f8f-d0690960ff11 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c" status: 200 len: 1522 microversion: 2.1 time: 0.327397 May 23 17:19:44.910235 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 110/211] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:44 2022] GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:44.920390 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a8947a30-2bb7-4fd8-b151-4147bdc9beb1 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:44.921801 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-a8947a30-2bb7-4fd8-b151-4147bdc9beb1 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2391a78f-53ee-4e0f-b59f-5978e3ee93a0] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:44.936398 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a8947a30-2bb7-4fd8-b151-4147bdc9beb1 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:44.938930 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a8947a30-2bb7-4fd8-b151-4147bdc9beb1 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:44.940120 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a8947a30-2bb7-4fd8-b151-4147bdc9beb1 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:44.944063 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a8947a30-2bb7-4fd8-b151-4147bdc9beb1 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:45.116890 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a8947a30-2bb7-4fd8-b151-4147bdc9beb1 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:45.126714 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-a8947a30-2bb7-4fd8-b151-4147bdc9beb1 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0" status: 200 len: 1210 microversion: 2.1 time: 0.215240 May 23 17:19:45.135103 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 111/212] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:44 2022] GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0 => generated 1210 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:45.156161 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e830ef5b-f9d3-4e1c-98d7-39737debd311 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:45.170108 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e830ef5b-f9d3-4e1c-98d7-39737debd311 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8" status: 200 len: 1497 microversion: 2.1 time: 0.394563 May 23 17:19:45.172917 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 102/213] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:44 2022] GET /compute/v2.1/servers/3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8 => generated 1497 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:45.925993 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-0d3245ae-682f-4be6-a445-13fd62951d2f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:45.926605 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-0d3245ae-682f-4be6-a445-13fd62951d2f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: e7b61ab9-ad21-427d-a451-1f721fb3a84c] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:45.934681 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0d3245ae-682f-4be6-a445-13fd62951d2f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:45.938646 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0d3245ae-682f-4be6-a445-13fd62951d2f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:45.939766 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0d3245ae-682f-4be6-a445-13fd62951d2f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:45.941784 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0d3245ae-682f-4be6-a445-13fd62951d2f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:46.161958 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9df9b205-10a8-4cbc-9d91-626baa6a9e00 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:46.165790 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9df9b205-10a8-4cbc-9d91-626baa6a9e00 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2391a78f-53ee-4e0f-b59f-5978e3ee93a0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:46.182915 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9df9b205-10a8-4cbc-9d91-626baa6a9e00 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:46.186443 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9df9b205-10a8-4cbc-9d91-626baa6a9e00 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:46.187299 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9df9b205-10a8-4cbc-9d91-626baa6a9e00 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:46.188923 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9df9b205-10a8-4cbc-9d91-626baa6a9e00 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:46.381774 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9df9b205-10a8-4cbc-9d91-626baa6a9e00 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:46.390936 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9df9b205-10a8-4cbc-9d91-626baa6a9e00 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0" status: 200 len: 1210 microversion: 2.1 time: 0.242557 May 23 17:19:46.391528 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 103/214] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:46 2022] GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0 => generated 1210 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:19:46.406243 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f467e87f-f7d4-4aae-868f-a63f6cf1ebec tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:46.406740 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f467e87f-f7d4-4aae-868f-a63f6cf1ebec tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: 3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:46.445402 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f467e87f-f7d4-4aae-868f-a63f6cf1ebec tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:46.445857 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f467e87f-f7d4-4aae-868f-a63f6cf1ebec tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:46.446638 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f467e87f-f7d4-4aae-868f-a63f6cf1ebec tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:46.447074 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f467e87f-f7d4-4aae-868f-a63f6cf1ebec tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:46.464689 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-0d3245ae-682f-4be6-a445-13fd62951d2f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:46.475989 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-0d3245ae-682f-4be6-a445-13fd62951d2f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c" status: 200 len: 1522 microversion: 2.1 time: 0.553893 May 23 17:19:46.477878 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 112/215] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:45 2022] GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c => generated 1522 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:46.523258 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f467e87f-f7d4-4aae-868f-a63f6cf1ebec tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: 3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8] Going to try to terminate instance {{(pid=117909) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 17:19:46.750686 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f467e87f-f7d4-4aae-868f-a63f6cf1ebec tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8" status: 204 len: 0 microversion: 2.1 time: 0.348334 May 23 17:19:46.751537 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 104/216] 10.222.0.46 () {58 vars in 1238 bytes} [Mon May 23 17:19:46 2022] DELETE /compute/v2.1/servers/3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 17:19:46.760862 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-0c328e23-dcb7-4dc3-9bb8-7e0b84a1a71a tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:46.761940 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-0c328e23-dcb7-4dc3-9bb8-7e0b84a1a71a tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: 3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:46.770034 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0c328e23-dcb7-4dc3-9bb8-7e0b84a1a71a tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:46.770788 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0c328e23-dcb7-4dc3-9bb8-7e0b84a1a71a tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:46.771736 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0c328e23-dcb7-4dc3-9bb8-7e0b84a1a71a tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:46.772376 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0c328e23-dcb7-4dc3-9bb8-7e0b84a1a71a tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:47.106232 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-0c328e23-dcb7-4dc3-9bb8-7e0b84a1a71a tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:47.115200 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-0c328e23-dcb7-4dc3-9bb8-7e0b84a1a71a tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8" status: 200 len: 1503 microversion: 2.1 time: 0.359197 May 23 17:19:47.118435 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 113/217] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:46 2022] GET /compute/v2.1/servers/3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8 => generated 1503 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:47.408318 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-930cbad6-5fce-45c5-adfb-ebe1670b091f tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:47.409069 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-930cbad6-5fce-45c5-adfb-ebe1670b091f tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2391a78f-53ee-4e0f-b59f-5978e3ee93a0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:47.424270 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-930cbad6-5fce-45c5-adfb-ebe1670b091f tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:47.425689 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-930cbad6-5fce-45c5-adfb-ebe1670b091f tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:47.427965 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-930cbad6-5fce-45c5-adfb-ebe1670b091f tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:47.433245 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-930cbad6-5fce-45c5-adfb-ebe1670b091f tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:47.494357 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-8ef0196e-c3ca-4e55-8e60-eaccc112c01d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:47.495584 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-8ef0196e-c3ca-4e55-8e60-eaccc112c01d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: e7b61ab9-ad21-427d-a451-1f721fb3a84c] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:47.509653 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8ef0196e-c3ca-4e55-8e60-eaccc112c01d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:47.511285 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8ef0196e-c3ca-4e55-8e60-eaccc112c01d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:47.516283 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8ef0196e-c3ca-4e55-8e60-eaccc112c01d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:47.517878 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8ef0196e-c3ca-4e55-8e60-eaccc112c01d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:47.759240 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-930cbad6-5fce-45c5-adfb-ebe1670b091f tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:47.773618 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-930cbad6-5fce-45c5-adfb-ebe1670b091f tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0" status: 200 len: 1264 microversion: 2.1 time: 0.369839 May 23 17:19:47.781234 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 105/218] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:47 2022] GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0 => generated 1264 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:47.822477 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-8ef0196e-c3ca-4e55-8e60-eaccc112c01d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:47.831748 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-8ef0196e-c3ca-4e55-8e60-eaccc112c01d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c" status: 200 len: 1522 microversion: 2.1 time: 0.341997 May 23 17:19:47.842306 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 114/219] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:47 2022] GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c => generated 1522 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:47.872054 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-291a2aa6-7b86-49ff-86e1-712a3feece33 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:47.872808 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-291a2aa6-7b86-49ff-86e1-712a3feece33 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:47.890542 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-291a2aa6-7b86-49ff-86e1-712a3feece33 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:47.891420 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-291a2aa6-7b86-49ff-86e1-712a3feece33 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:47.893018 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-291a2aa6-7b86-49ff-86e1-712a3feece33 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:47.894074 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-291a2aa6-7b86-49ff-86e1-712a3feece33 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:47.995499 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-291a2aa6-7b86-49ff-86e1-712a3feece33 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091/ips" status: 200 len: 152 microversion: 2.20 time: 0.127596 May 23 17:19:48.008180 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 106/220] 10.222.0.46 () {60 vars in 1288 bytes} [Mon May 23 17:19:47 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091/ips => generated 152 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 17:19:48.137083 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2dd325ad-6bda-4909-b6cf-3a780b8448dc tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:48.138821 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2dd325ad-6bda-4909-b6cf-3a780b8448dc tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: 3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:48.147292 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2dd325ad-6bda-4909-b6cf-3a780b8448dc tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:48.149264 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2dd325ad-6bda-4909-b6cf-3a780b8448dc tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:48.152488 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2dd325ad-6bda-4909-b6cf-3a780b8448dc tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:48.154587 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2dd325ad-6bda-4909-b6cf-3a780b8448dc tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:48.413598 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2dd325ad-6bda-4909-b6cf-3a780b8448dc tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:48.426067 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2dd325ad-6bda-4909-b6cf-3a780b8448dc tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8" status: 200 len: 1503 microversion: 2.1 time: 0.294208 May 23 17:19:48.427121 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 115/221] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:48 2022] GET /compute/v2.1/servers/3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8 => generated 1503 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:48.806677 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3afc91ee-4b8b-4cfa-a4ef-b4e6e9ac8fb1 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:48.807344 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3afc91ee-4b8b-4cfa-a4ef-b4e6e9ac8fb1 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2391a78f-53ee-4e0f-b59f-5978e3ee93a0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:48.815127 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3afc91ee-4b8b-4cfa-a4ef-b4e6e9ac8fb1 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:48.816052 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3afc91ee-4b8b-4cfa-a4ef-b4e6e9ac8fb1 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:48.817301 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3afc91ee-4b8b-4cfa-a4ef-b4e6e9ac8fb1 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:48.818117 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3afc91ee-4b8b-4cfa-a4ef-b4e6e9ac8fb1 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:48.850245 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-f32f9418-1561-47ff-8259-b80c1d7fa047 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:48.851893 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-f32f9418-1561-47ff-8259-b80c1d7fa047 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: e7b61ab9-ad21-427d-a451-1f721fb3a84c] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:48.869649 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f32f9418-1561-47ff-8259-b80c1d7fa047 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:48.873771 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f32f9418-1561-47ff-8259-b80c1d7fa047 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:48.874555 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f32f9418-1561-47ff-8259-b80c1d7fa047 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:48.874983 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f32f9418-1561-47ff-8259-b80c1d7fa047 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:49.700679 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3afc91ee-4b8b-4cfa-a4ef-b4e6e9ac8fb1 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:49.708422 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3afc91ee-4b8b-4cfa-a4ef-b4e6e9ac8fb1 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0" status: 200 len: 1264 microversion: 2.1 time: 0.907732 May 23 17:19:49.717015 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 107/222] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:48 2022] GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0 => generated 1264 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:49.722465 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6593ad1d-221d-4dbc-a8ca-d2945a70a6fc tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:49.723355 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6593ad1d-221d-4dbc-a8ca-d2945a70a6fc tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: 3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:49.754623 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6593ad1d-221d-4dbc-a8ca-d2945a70a6fc tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:49.755060 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6593ad1d-221d-4dbc-a8ca-d2945a70a6fc tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:49.766285 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6593ad1d-221d-4dbc-a8ca-d2945a70a6fc tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:49.769580 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6593ad1d-221d-4dbc-a8ca-d2945a70a6fc tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:49.873266 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-f32f9418-1561-47ff-8259-b80c1d7fa047 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:49.886514 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-f32f9418-1561-47ff-8259-b80c1d7fa047 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c" status: 200 len: 1502 microversion: 2.1 time: 1.041068 May 23 17:19:49.904730 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 116/223] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:48 2022] GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c => generated 1502 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:19:49.911755 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-3f6d8a5c-3b4c-47e9-a81c-ea5372b4acc9 req-e1ed0390-6a13-4e49-818a-2ea8c06134fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2391a78f-53ee-4e0f-b59f-5978e3ee93a0", "tag": "d1a4e9d0-3b46-48b5-8e5d-788e05f3721f"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:19:49.935349 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-3f6d8a5c-3b4c-47e9-a81c-ea5372b4acc9 req-e1ed0390-6a13-4e49-818a-2ea8c06134fa service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:49.936115 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-3f6d8a5c-3b4c-47e9-a81c-ea5372b4acc9 req-e1ed0390-6a13-4e49-818a-2ea8c06134fa service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:49.967465 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-3f6d8a5c-3b4c-47e9-a81c-ea5372b4acc9 req-e1ed0390-6a13-4e49-818a-2ea8c06134fa service nova] Creating event network-changed:d1a4e9d0-3b46-48b5-8e5d-788e05f3721f for instance 2391a78f-53ee-4e0f-b59f-5978e3ee93a0 on hv-cinder-84299 May 23 17:19:49.976642 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-3f6d8a5c-3b4c-47e9-a81c-ea5372b4acc9 req-e1ed0390-6a13-4e49-818a-2ea8c06134fa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068373 May 23 17:19:49.984150 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 117/224] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:19:49.999924 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-0f77672b-5832-469e-81b7-1a4c3c1d5535 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f083e9cd-0dc8-44e0-a905-04cc8ac035ce"}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:19:50.000329 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-0f77672b-5832-469e-81b7-1a4c3c1d5535 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: e7b61ab9-ad21-427d-a451-1f721fb3a84c] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:50.029566 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0f77672b-5832-469e-81b7-1a4c3c1d5535 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:50.030939 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0f77672b-5832-469e-81b7-1a4c3c1d5535 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:50.032415 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0f77672b-5832-469e-81b7-1a4c3c1d5535 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:50.034731 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0f77672b-5832-469e-81b7-1a4c3c1d5535 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:50.125046 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-0f77672b-5832-469e-81b7-1a4c3c1d5535 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] HTTP exception thrown: Cannot 'attach_volume' instance e7b61ab9-ad21-427d-a451-1f721fb3a84c while it is in vm_state rescued May 23 17:19:50.135284 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-0f77672b-5832-469e-81b7-1a4c3c1d5535 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Request method failure captured: May 23 17:19:50.135284 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: request: POST /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c/os-volume_attachments HTTP/1.1 May 23 17:19:50.135284 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept: application/json May 23 17:19:50.135284 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity May 23 17:19:50.135284 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Connection: close May 23 17:19:50.135284 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Length: 74 May 23 17:19:50.135284 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Type: application/json May 23 17:19:50.135284 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Host: 10.222.0.46 May 23 17:19:50.135284 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None May 23 17:19:50.135284 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.9 May 23 17:19:50.135284 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABii8HG0mgu4EO3OIfAaF2B3uvrt0HWl6redgiQ2amic5kI7hYTXFXsPdkkm5i1trVjfr7y7aQu40FrA_H1McTmt606JBABM6--n7E5dMGSGOv1HeOooMYCBiNeUywA0TG4sUNGbtPMRvIBMzMxwPFKuLlh0QtTh2yEErLoqKMT2s-W6-g May 23 17:19:50.135284 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Id: None May 23 17:19:50.135284 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Name: None May 23 17:19:50.135284 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed May 23 17:19:50.135284 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True May 23 17:19:50.135284 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default May 23 17:19:50.135284 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default May 23 17:19:50.135284 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Id: 9b1709bec893431599352cb6e470cf76 May 23 17:19:50.135284 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-407230310 May 23 17:19:50.135284 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Role: reader,member May 23 17:19:50.135284 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Roles: reader,member May 23 17:19:50.136880 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9b1709bec893431599352cb6e470cf76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9b1709bec893431599352cb6e470cf76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9b1709bec893431599352cb6e470cf76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9b1709bec893431599352cb6e470cf76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:19:50.136880 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-ServerRescueNegativeTestJSON-407230310 May 23 17:19:50.136880 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 9b1709bec893431599352cb6e470cf76 May 23 17:19:50.136880 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-407230310 May 23 17:19:50.136880 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User: tempest-ServerRescueNegativeTestJSON-407230310-project May 23 17:19:50.136880 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default May 23 17:19:50.136880 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default May 23 17:19:50.136880 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Id: 8c5d1f4f0bec40ad8e325f8f92739b4d May 23 17:19:50.136880 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-ServerRescueNegativeTestJSON-407230310-project May 23 17:19:50.136880 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: May 23 17:19:50.136880 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: {"volumeAttachment": {"volumeId": "f083e9cd-0dc8-44e0-a905-04cc8ac035ce"}} May 23 17:19:50.136880 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: method: > May 23 17:19:50.138292 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: exception: Cannot 'attach_volume' instance e7b61ab9-ad21-427d-a451-1f721fb3a84c while it is in vm_state rescued May 23 17:19:50.138292 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: action_args: {'server_id': 'e7b61ab9-ad21-427d-a451-1f721fb3a84c', 'body': {'volumeAttachment': {'volumeId': 'f083e9cd-0dc8-44e0-a905-04cc8ac035ce'}}} May 23 17:19:50.138292 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:19:50.138292 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:19:50.138292 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 23 17:19:50.138292 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 23 17:19:50.138292 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 17:19:50.138292 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 17:19:50.138292 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 23 17:19:50.138292 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 23 17:19:50.138292 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e7b61ab9-ad21-427d-a451-1f721fb3a84c in vm_state rescued. Cannot attach_volume while the instance is in this state. May 23 17:19:50.138292 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:19:50.138292 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:19:50.138292 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:19:50.138292 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:19:50.138292 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:19:50.138292 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:19:50.138292 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:19:50.138292 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:19:50.139740 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:19:50.139740 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:19:50.139740 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 17:19:50.139740 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 17:19:50.139740 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 17:19:50.139740 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 17:19:50.139740 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 17:19:50.139740 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 17:19:50.139740 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 23 17:19:50.139740 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 23 17:19:50.139740 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 23 17:19:50.139740 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 23 17:19:50.139740 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e7b61ab9-ad21-427d-a451-1f721fb3a84c while it is in vm_state rescued May 23 17:19:50.139740 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:19:50.139740 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:19:50.139740 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:19:50.139740 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:19:50.139740 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:19:50.139740 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:19:50.141115 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:19:50.141115 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:19:50.141115 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e7b61ab9-ad21-427d-a451-1f721fb3a84c while it is in vm_state rescued May 23 17:19:50.141115 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:19:50.141115 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-0f77672b-5832-469e-81b7-1a4c3c1d5535 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Returning 409 to user: Cannot 'attach_volume' instance e7b61ab9-ad21-427d-a451-1f721fb3a84c while it is in vm_state rescued {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:19:50.142148 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-0f77672b-5832-469e-81b7-1a4c3c1d5535 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "POST /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.156516 May 23 17:19:50.142863 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 118/225] 10.222.0.46 () {60 vars in 1322 bytes} [Mon May 23 17:19:49 2022] POST /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c/os-volume_attachments => generated 152 bytes in 158 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 23 17:19:50.151501 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-57614c88-1d38-4f58-ba18-707c12e4e698 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:19:50.157560 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-57614c88-1d38-4f58-ba18-707c12e4e698 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: e7b61ab9-ad21-427d-a451-1f721fb3a84c] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:50.178556 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-57614c88-1d38-4f58-ba18-707c12e4e698 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:50.179447 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-57614c88-1d38-4f58-ba18-707c12e4e698 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:50.180447 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-57614c88-1d38-4f58-ba18-707c12e4e698 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:50.181537 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-57614c88-1d38-4f58-ba18-707c12e4e698 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:50.289991 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-57614c88-1d38-4f58-ba18-707c12e4e698 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "POST /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c/action" status: 202 len: 0 microversion: 2.1 time: 0.142119 May 23 17:19:50.294169 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 119/226] 10.222.0.46 () {60 vars in 1277 bytes} [Mon May 23 17:19:50 2022] POST /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 17:19:50.300396 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-ac4cf176-e91c-4eea-9c98-08b12dff8035 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:50.301537 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-ac4cf176-e91c-4eea-9c98-08b12dff8035 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: e7b61ab9-ad21-427d-a451-1f721fb3a84c] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:50.310682 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ac4cf176-e91c-4eea-9c98-08b12dff8035 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:50.311550 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ac4cf176-e91c-4eea-9c98-08b12dff8035 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:50.312640 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ac4cf176-e91c-4eea-9c98-08b12dff8035 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:50.313453 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ac4cf176-e91c-4eea-9c98-08b12dff8035 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:50.493627 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6593ad1d-221d-4dbc-a8ca-d2945a70a6fc tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:50.513813 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6593ad1d-221d-4dbc-a8ca-d2945a70a6fc tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8" status: 200 len: 1503 microversion: 2.1 time: 0.793801 May 23 17:19:50.518310 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 108/227] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:49 2022] GET /compute/v2.1/servers/3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8 => generated 1503 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:50.530167 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0d8441a0-aad7-4cd5-b51b-eb93d58fe2c8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:19:50.530952 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0d8441a0-aad7-4cd5-b51b-eb93d58fe2c8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:50.549746 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0d8441a0-aad7-4cd5-b51b-eb93d58fe2c8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:50.551667 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0d8441a0-aad7-4cd5-b51b-eb93d58fe2c8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:50.555458 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0d8441a0-aad7-4cd5-b51b-eb93d58fe2c8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:50.556882 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0d8441a0-aad7-4cd5-b51b-eb93d58fe2c8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:50.607421 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.objects.instance [None req-0d8441a0-aad7-4cd5-b51b-eb93d58fe2c8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lazy-loading 'flavor' on Instance uuid f4273c3a-0aba-4184-b088-2feaea1b1091 {{(pid=117909) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 17:19:51.164766 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0d8441a0-aad7-4cd5-b51b-eb93d58fe2c8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "POST /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091/action" status: 202 len: 0 microversion: 2.20 time: 0.644879 May 23 17:19:51.169676 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 109/228] 10.222.0.46 () {62 vars in 1318 bytes} [Mon May 23 17:19:50 2022] POST /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091/action => generated 0 bytes in 651 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 17:19:51.187075 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9c74e246-6214-420d-818f-6ca0c1c3e551 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:51.188113 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9c74e246-6214-420d-818f-6ca0c1c3e551 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2391a78f-53ee-4e0f-b59f-5978e3ee93a0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:51.201090 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9c74e246-6214-420d-818f-6ca0c1c3e551 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:51.202187 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9c74e246-6214-420d-818f-6ca0c1c3e551 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:51.203177 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9c74e246-6214-420d-818f-6ca0c1c3e551 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:51.203768 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9c74e246-6214-420d-818f-6ca0c1c3e551 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:51.327511 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ac4cf176-e91c-4eea-9c98-08b12dff8035 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:51.335975 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-ac4cf176-e91c-4eea-9c98-08b12dff8035 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c" status: 200 len: 1510 microversion: 2.1 time: 1.040268 May 23 17:19:51.338394 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 120/229] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:50 2022] GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c => generated 1510 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:51.355708 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-e8b5ef0d-8f85-4432-8156-33e10a087c87 req-c0435937-5aa0-4a4f-9bcb-f054bd89cf5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8", "name": "network-vif-deleted", "tag": "505ddb52-e6c9-4358-b5b3-4888f0d9d834"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:19:51.375075 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-e8b5ef0d-8f85-4432-8156-33e10a087c87 req-c0435937-5aa0-4a4f-9bcb-f054bd89cf5a service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:51.377773 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-e8b5ef0d-8f85-4432-8156-33e10a087c87 req-c0435937-5aa0-4a4f-9bcb-f054bd89cf5a service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:51.409794 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-e8b5ef0d-8f85-4432-8156-33e10a087c87 req-c0435937-5aa0-4a4f-9bcb-f054bd89cf5a service nova] Creating event network-vif-deleted:505ddb52-e6c9-4358-b5b3-4888f0d9d834 for instance 3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8 on hv-cinder-84299 May 23 17:19:51.426884 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-e8b5ef0d-8f85-4432-8156-33e10a087c87 req-c0435937-5aa0-4a4f-9bcb-f054bd89cf5a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083564 May 23 17:19:51.427852 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 121/230] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:19:51.443815 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d145ba7a-2bd7-4045-94f6-02e2516e25ad tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:51.445241 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d145ba7a-2bd7-4045-94f6-02e2516e25ad tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:51.460102 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d145ba7a-2bd7-4045-94f6-02e2516e25ad tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:51.462845 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d145ba7a-2bd7-4045-94f6-02e2516e25ad tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:51.465719 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d145ba7a-2bd7-4045-94f6-02e2516e25ad tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:51.466443 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d145ba7a-2bd7-4045-94f6-02e2516e25ad tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:51.563936 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9c74e246-6214-420d-818f-6ca0c1c3e551 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:51.573808 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9c74e246-6214-420d-818f-6ca0c1c3e551 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0" status: 200 len: 1264 microversion: 2.1 time: 0.402730 May 23 17:19:51.585965 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 110/231] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:51 2022] GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0 => generated 1264 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:51.593194 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a7ed432c-a07c-4462-a425-83c8a11ddb52 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:51.594046 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a7ed432c-a07c-4462-a425-83c8a11ddb52 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: 3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:51.601724 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a7ed432c-a07c-4462-a425-83c8a11ddb52 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:51.602392 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a7ed432c-a07c-4462-a425-83c8a11ddb52 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:51.603416 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a7ed432c-a07c-4462-a425-83c8a11ddb52 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:51.604064 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a7ed432c-a07c-4462-a425-83c8a11ddb52 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:51.620366 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-a7ed432c-a07c-4462-a425-83c8a11ddb52 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] HTTP exception thrown: Instance 3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8 could not be found. May 23 17:19:51.622653 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a7ed432c-a07c-4462-a425-83c8a11ddb52 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Request method failure captured: May 23 17:19:51.622653 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: request: GET /compute/v2.1/servers/3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8 HTTP/1.1 May 23 17:19:51.622653 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept: application/json May 23 17:19:51.622653 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity May 23 17:19:51.622653 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Connection: close May 23 17:19:51.622653 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Length: 0 May 23 17:19:51.622653 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Type: application/json May 23 17:19:51.622653 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Host: 10.222.0.46 May 23 17:19:51.622653 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None May 23 17:19:51.622653 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.9 May 23 17:19:51.622653 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABii8IZIj4ejcgBk8UEeEUYtmxvYyBBzlXVyMoYRmpwPkoekSPqjwM15OCZ4NJDyxaD_WUbfKJpP9BIkQJyj0joJj_JCgvWhMPLT8rjzDweJ8eDk_atHZ0d92PFlbjjyoudi6DhjnYxSsNBvKYOXBPcBnesBC2xmvH1u7H1VzOwiPCC4ZI May 23 17:19:51.622653 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Id: None May 23 17:19:51.622653 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Name: None May 23 17:19:51.622653 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed May 23 17:19:51.622653 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True May 23 17:19:51.622653 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default May 23 17:19:51.622653 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default May 23 17:19:51.622653 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Id: 31c15be59539430b9f25b8236c4d03c7 May 23 17:19:51.622653 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-VolumesActionsTest-2079560654 May 23 17:19:51.622653 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Role: reader,member May 23 17:19:51.622653 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Roles: reader,member May 23 17:19:51.624412 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31c15be59539430b9f25b8236c4d03c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/31c15be59539430b9f25b8236c4d03c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31c15be59539430b9f25b8236c4d03c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_31c15be59539430b9f25b8236c4d03c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:19:51.624412 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-VolumesActionsTest-2079560654 May 23 17:19:51.624412 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 31c15be59539430b9f25b8236c4d03c7 May 23 17:19:51.624412 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-VolumesActionsTest-2079560654 May 23 17:19:51.624412 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User: tempest-VolumesActionsTest-2079560654-project May 23 17:19:51.624412 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default May 23 17:19:51.624412 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default May 23 17:19:51.624412 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Id: b88d284f57a44ddcb0f1347942a2950b May 23 17:19:51.624412 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-VolumesActionsTest-2079560654-project May 23 17:19:51.624412 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: method: > May 23 17:19:51.624412 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: exception: Instance 3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8 could not be found. May 23 17:19:51.624412 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: action_args: {'id': '3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8'} May 23 17:19:51.625275 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:19:51.625275 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:19:51.625275 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:19:51.625275 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:19:51.625275 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:19:51.625275 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:19:51.625275 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:19:51.625275 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:19:51.625275 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:19:51.625275 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:19:51.625275 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8 could not be found. May 23 17:19:51.625275 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:19:51.625275 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:19:51.625275 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:19:51.625275 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:19:51.625275 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:19:51.625275 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:19:51.625275 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:19:51.625275 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:19:51.625275 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:19:51.626802 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:19:51.626802 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 17:19:51.626802 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 17:19:51.626802 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:19:51.626802 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:19:51.626802 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:19:51.626802 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:19:51.626802 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8 could not be found. May 23 17:19:51.626802 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:19:51.626802 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:19:51.626802 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:19:51.626802 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:19:51.626802 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:19:51.626802 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:19:51.626802 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:19:51.626802 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:19:51.626802 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8 could not be found. May 23 17:19:51.626802 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:19:51.631103 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a7ed432c-a07c-4462-a425-83c8a11ddb52 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Returning 404 to user: Instance 3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8 could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:19:51.632326 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a7ed432c-a07c-4462-a425-83c8a11ddb52 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8" status: 404 len: 111 microversion: 2.1 time: 0.044925 May 23 17:19:51.633210 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 111/232] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:51 2022] GET /compute/v2.1/servers/3e3e77fd-d5d4-4f8c-a60d-c07932dbdba8 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:19:51.812766 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=2 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:51.813739 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=6 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:51.827619 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e73b99a6-00ac-42df-b0fa-72d2aa492cac tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1474802923", "imageRef": "99870172-61a4-4218-9407-6a6da3fb5c83", "flavorRef": "452", "networks": [{"uuid": "0cf25c9b-22b7-4ee3-b051-3ed242490f5b"}]}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:19:51.927854 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.network.neutron [None req-e73b99a6-00ac-42df-b0fa-72d2aa492cac tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] validate_networks() for [('0cf25c9b-22b7-4ee3-b051-3ed242490f5b', None, None, None, None, None)] {{(pid=117909) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 17:19:51.937791 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d145ba7a-2bd7-4045-94f6-02e2516e25ad tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:51.954805 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d145ba7a-2bd7-4045-94f6-02e2516e25ad tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:51.956720 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d145ba7a-2bd7-4045-94f6-02e2516e25ad tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:51.958123 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d145ba7a-2bd7-4045-94f6-02e2516e25ad tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1724 microversion: 2.20 time: 0.527693 May 23 17:19:51.958692 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 122/233] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:19:51 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1724 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:19:52.369888 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d4fcea8d-d26f-4654-b12e-c67151594ed0 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:52.373357 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d4fcea8d-d26f-4654-b12e-c67151594ed0 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: e7b61ab9-ad21-427d-a451-1f721fb3a84c] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:52.390840 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d4fcea8d-d26f-4654-b12e-c67151594ed0 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:52.394664 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d4fcea8d-d26f-4654-b12e-c67151594ed0 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:52.400558 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d4fcea8d-d26f-4654-b12e-c67151594ed0 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:52.401324 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d4fcea8d-d26f-4654-b12e-c67151594ed0 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:52.428586 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:52.447456 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=2 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:52.774874 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d4fcea8d-d26f-4654-b12e-c67151594ed0 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:52.788154 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-e73b99a6-00ac-42df-b0fa-72d2aa492cac tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Flavor limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 17:19:52.789513 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-e73b99a6-00ac-42df-b0fa-72d2aa492cac tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Image limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 17:19:52.790155 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-e73b99a6-00ac-42df-b0fa-72d2aa492cac tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Flavor pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 17:19:52.790727 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-e73b99a6-00ac-42df-b0fa-72d2aa492cac tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Image pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 17:19:52.791306 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-e73b99a6-00ac-42df-b0fa-72d2aa492cac tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 17:19:52.803070 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d4fcea8d-d26f-4654-b12e-c67151594ed0 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c" status: 200 len: 1510 microversion: 2.1 time: 0.450451 May 23 17:19:52.818133 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 123/234] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:52 2022] GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c => generated 1510 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:52.823848 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b94fae82-5e39-4686-a41b-137916df2b02 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:52.824837 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-b94fae82-5e39-4686-a41b-137916df2b02 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2391a78f-53ee-4e0f-b59f-5978e3ee93a0] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:52.831988 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e73b99a6-00ac-42df-b0fa-72d2aa492cac tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:52.836620 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e73b99a6-00ac-42df-b0fa-72d2aa492cac tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:52.839125 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e73b99a6-00ac-42df-b0fa-72d2aa492cac tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:52.841273 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e73b99a6-00ac-42df-b0fa-72d2aa492cac tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:52.858281 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b94fae82-5e39-4686-a41b-137916df2b02 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:52.858748 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b94fae82-5e39-4686-a41b-137916df2b02 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:52.860523 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b94fae82-5e39-4686-a41b-137916df2b02 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:52.863983 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b94fae82-5e39-4686-a41b-137916df2b02 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:52.892586 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-e73b99a6-00ac-42df-b0fa-72d2aa492cac tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Getting quotas for project 31c15be59539430b9f25b8236c4d03c7. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 17:19:52.903790 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-e73b99a6-00ac-42df-b0fa-72d2aa492cac tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Getting quotas for user b88d284f57a44ddcb0f1347942a2950b and project 31c15be59539430b9f25b8236c4d03c7. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 17:19:52.934298 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e73b99a6-00ac-42df-b0fa-72d2aa492cac tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Going to run 1 instances... {{(pid=117909) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 17:19:52.941444 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e73b99a6-00ac-42df-b0fa-72d2aa492cac tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: ee74a742-e7c0-4541-8302-b655a0d946ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99870172-61a4-4218-9407-6a6da3fb5c83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 17:19:53.092347 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e73b99a6-00ac-42df-b0fa-72d2aa492cac tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.280231 May 23 17:19:53.095369 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 112/235] 10.222.0.46 () {60 vars in 1146 bytes} [Mon May 23 17:19:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1285 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 23 17:19:53.105904 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3988785a-1fc7-4aaf-8d2a-0136de20500b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:53.107145 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3988785a-1fc7-4aaf-8d2a-0136de20500b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:53.115478 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3988785a-1fc7-4aaf-8d2a-0136de20500b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:53.117271 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3988785a-1fc7-4aaf-8d2a-0136de20500b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:53.118981 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3988785a-1fc7-4aaf-8d2a-0136de20500b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:53.119778 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3988785a-1fc7-4aaf-8d2a-0136de20500b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:53.250092 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b94fae82-5e39-4686-a41b-137916df2b02 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:53.262202 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b94fae82-5e39-4686-a41b-137916df2b02 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0" status: 200 len: 1264 microversion: 2.1 time: 0.442588 May 23 17:19:53.263518 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 124/236] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:52 2022] GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0 => generated 1264 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:53.270729 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-ebd54375-6645-46d5-ab68-cabaa1a8a5ba tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:53.271559 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-ebd54375-6645-46d5-ab68-cabaa1a8a5ba tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: ee74a742-e7c0-4541-8302-b655a0d946ee] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:53.361825 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ebd54375-6645-46d5-ab68-cabaa1a8a5ba tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:53.368958 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-ebd54375-6645-46d5-ab68-cabaa1a8a5ba tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee" status: 200 len: 1214 microversion: 2.1 time: 0.104343 May 23 17:19:53.372207 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 125/237] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:53 2022] GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee => generated 1214 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:53.415657 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3988785a-1fc7-4aaf-8d2a-0136de20500b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:53.426542 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3988785a-1fc7-4aaf-8d2a-0136de20500b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:53.432993 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3988785a-1fc7-4aaf-8d2a-0136de20500b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:53.432993 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3988785a-1fc7-4aaf-8d2a-0136de20500b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1724 microversion: 2.20 time: 0.333591 May 23 17:19:53.432993 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 113/238] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:19:53 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1724 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:19:53.822340 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-bb1d3634-e49a-486c-a6cd-0d59ebcf99dc tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:53.823142 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-bb1d3634-e49a-486c-a6cd-0d59ebcf99dc tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: e7b61ab9-ad21-427d-a451-1f721fb3a84c] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:53.834610 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bb1d3634-e49a-486c-a6cd-0d59ebcf99dc tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:53.837524 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bb1d3634-e49a-486c-a6cd-0d59ebcf99dc tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:53.838533 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bb1d3634-e49a-486c-a6cd-0d59ebcf99dc tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:53.841151 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bb1d3634-e49a-486c-a6cd-0d59ebcf99dc tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:54.131967 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-bb1d3634-e49a-486c-a6cd-0d59ebcf99dc tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:54.144201 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-bb1d3634-e49a-486c-a6cd-0d59ebcf99dc tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c" status: 200 len: 1516 microversion: 2.1 time: 0.325891 May 23 17:19:54.157859 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 126/239] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:53 2022] GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c => generated 1516 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:54.280732 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-bb37c6d0-2a74-47f2-b741-55f1c0e81052 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:54.282054 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-bb37c6d0-2a74-47f2-b741-55f1c0e81052 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2391a78f-53ee-4e0f-b59f-5978e3ee93a0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:54.299218 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bb37c6d0-2a74-47f2-b741-55f1c0e81052 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:54.300503 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bb37c6d0-2a74-47f2-b741-55f1c0e81052 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:54.303036 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bb37c6d0-2a74-47f2-b741-55f1c0e81052 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:54.307696 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bb37c6d0-2a74-47f2-b741-55f1c0e81052 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:54.358130 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:19:54.389720 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-cae2dd2d-da37-4b5f-a961-75217dc4a4fe tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:54.390976 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-cae2dd2d-da37-4b5f-a961-75217dc4a4fe tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: ee74a742-e7c0-4541-8302-b655a0d946ee] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:54.410591 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cae2dd2d-da37-4b5f-a961-75217dc4a4fe tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:54.411036 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cae2dd2d-da37-4b5f-a961-75217dc4a4fe tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:54.414291 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cae2dd2d-da37-4b5f-a961-75217dc4a4fe tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:54.416368 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cae2dd2d-da37-4b5f-a961-75217dc4a4fe tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:54.648373 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-cae2dd2d-da37-4b5f-a961-75217dc4a4fe tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:54.661593 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-cae2dd2d-da37-4b5f-a961-75217dc4a4fe tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee" status: 200 len: 1210 microversion: 2.1 time: 0.276179 May 23 17:19:54.663303 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 127/240] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:54 2022] GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee => generated 1210 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:19:54.672035 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-ec813abd-8b1f-4f1b-bba3-b5bb1a3ef34a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:54.675870 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-ec813abd-8b1f-4f1b-bba3-b5bb1a3ef34a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:54.686136 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ec813abd-8b1f-4f1b-bba3-b5bb1a3ef34a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:54.687228 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ec813abd-8b1f-4f1b-bba3-b5bb1a3ef34a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:54.687927 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ec813abd-8b1f-4f1b-bba3-b5bb1a3ef34a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:54.688350 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ec813abd-8b1f-4f1b-bba3-b5bb1a3ef34a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:54.726369 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-bb37c6d0-2a74-47f2-b741-55f1c0e81052 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:54.734898 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-bb37c6d0-2a74-47f2-b741-55f1c0e81052 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0" status: 200 len: 1264 microversion: 2.1 time: 0.459055 May 23 17:19:54.739638 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 114/241] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:54 2022] GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0 => generated 1264 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:55.063553 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-828a4d4b-ea60-4d1c-a930-962d887bdb12 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1981424747", "imageRef": "99870172-61a4-4218-9407-6a6da3fb5c83", "flavorRef": "452", "networks": [{"uuid": "4dd05859-d197-4158-b1d0-4b2dca1b49ac"}]}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:19:55.083775 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ec813abd-8b1f-4f1b-bba3-b5bb1a3ef34a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:55.092339 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ec813abd-8b1f-4f1b-bba3-b5bb1a3ef34a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:55.105942 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ec813abd-8b1f-4f1b-bba3-b5bb1a3ef34a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:55.107266 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-ec813abd-8b1f-4f1b-bba3-b5bb1a3ef34a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1724 microversion: 2.20 time: 0.442955 May 23 17:19:55.107824 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 128/242] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:19:54 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1724 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:19:55.190552 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.network.neutron [None req-828a4d4b-ea60-4d1c-a930-962d887bdb12 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] validate_networks() for [('4dd05859-d197-4158-b1d0-4b2dca1b49ac', None, None, None, None, None)] {{(pid=117909) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 17:19:55.683254 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-54be82fb-8138-4bc6-987d-772f5be131c0 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:55.685062 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-54be82fb-8138-4bc6-987d-772f5be131c0 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: ee74a742-e7c0-4541-8302-b655a0d946ee] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:55.691294 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-54be82fb-8138-4bc6-987d-772f5be131c0 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:55.691926 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-54be82fb-8138-4bc6-987d-772f5be131c0 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:55.692890 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-54be82fb-8138-4bc6-987d-772f5be131c0 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:55.693930 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-54be82fb-8138-4bc6-987d-772f5be131c0 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:55.803734 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-54be82fb-8138-4bc6-987d-772f5be131c0 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:55.813874 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-54be82fb-8138-4bc6-987d-772f5be131c0 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee" status: 200 len: 1272 microversion: 2.1 time: 0.135484 May 23 17:19:55.815057 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 129/243] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:55 2022] GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee => generated 1272 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:55.819760 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-bbd56b16-b361-4554-b3c0-ac92f6a994f5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Action: 'create', calling method: .version_select at 0x7fd7a0756f70>, body: {"keypair": {"name": "tempest-keypair-1190045884", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+uAyp9xA5IXeNCgdPKHzfdzXBWCT/rMXCPCoskf7oBFjQniMsDC/y/YIKifwlhXJpSxnB4UBAaSSX12tLVtoqPxY6yeaL4gWqXxdDFeA6VU2UGPVRzLv+yNqTqqDYIjQ=="}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:19:55.837712 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-bbd56b16-b361-4554-b3c0-ac92f6a994f5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Getting quotas for project 9b1709bec893431599352cb6e470cf76. Resources: {'key_pairs'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 17:19:55.843118 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-bbd56b16-b361-4554-b3c0-ac92f6a994f5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Getting quotas for user 8c5d1f4f0bec40ad8e325f8f92739b4d and project 9b1709bec893431599352cb6e470cf76. Resources: {'key_pairs'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 17:19:55.849116 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-828a4d4b-ea60-4d1c-a930-962d887bdb12 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Flavor limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 17:19:55.849621 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-828a4d4b-ea60-4d1c-a930-962d887bdb12 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Image limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 17:19:55.850158 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-828a4d4b-ea60-4d1c-a930-962d887bdb12 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Flavor pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 17:19:55.850805 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-828a4d4b-ea60-4d1c-a930-962d887bdb12 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Image pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 17:19:55.851471 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-828a4d4b-ea60-4d1c-a930-962d887bdb12 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 17:19:55.873514 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-bbd56b16-b361-4554-b3c0-ac92f6a994f5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056950 May 23 17:19:55.874784 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-828a4d4b-ea60-4d1c-a930-962d887bdb12 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:55.875396 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-828a4d4b-ea60-4d1c-a930-962d887bdb12 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:55.876551 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-828a4d4b-ea60-4d1c-a930-962d887bdb12 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:55.877196 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-828a4d4b-ea60-4d1c-a930-962d887bdb12 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:55.882539 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 130/244] 10.222.0.46 () {60 vars in 1158 bytes} [Mon May 23 17:19:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:19:55.887484 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-1738c68e-2e6b-493d-baf8-998eae3a5968 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:55.888530 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-1738c68e-2e6b-493d-baf8-998eae3a5968 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2391a78f-53ee-4e0f-b59f-5978e3ee93a0] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:55.895879 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1738c68e-2e6b-493d-baf8-998eae3a5968 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:55.896321 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1738c68e-2e6b-493d-baf8-998eae3a5968 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:55.897193 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1738c68e-2e6b-493d-baf8-998eae3a5968 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:55.897796 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1738c68e-2e6b-493d-baf8-998eae3a5968 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:55.900055 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-828a4d4b-ea60-4d1c-a930-962d887bdb12 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Getting quotas for project 19de3d45e12e40a9949c91c7f1cd4fe3. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 17:19:55.908540 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-828a4d4b-ea60-4d1c-a930-962d887bdb12 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Getting quotas for user 25c25a40827e4737a7ae823dee8615be and project 19de3d45e12e40a9949c91c7f1cd4fe3. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 17:19:55.933847 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-828a4d4b-ea60-4d1c-a930-962d887bdb12 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Going to run 1 instances... {{(pid=117909) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 17:19:55.938378 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-828a4d4b-ea60-4d1c-a930-962d887bdb12 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 6664de84-4c36-42da-9577-594b6bc73fec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99870172-61a4-4218-9407-6a6da3fb5c83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 17:19:56.032901 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-828a4d4b-ea60-4d1c-a930-962d887bdb12 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.975873 May 23 17:19:56.038980 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 115/245] 10.222.0.46 () {60 vars in 1146 bytes} [Mon May 23 17:19:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 17:19:56.044022 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4bb7d223-3b77-4c9a-ac65-1faa3fbbd3ab tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:56.055482 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4bb7d223-3b77-4c9a-ac65-1faa3fbbd3ab tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 6664de84-4c36-42da-9577-594b6bc73fec] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:56.153411 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-1738c68e-2e6b-493d-baf8-998eae3a5968 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:56.168794 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-1738c68e-2e6b-493d-baf8-998eae3a5968 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0" status: 200 len: 1264 microversion: 2.1 time: 0.285200 May 23 17:19:56.173472 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 131/246] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:55 2022] GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0 => generated 1264 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:56.187650 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-409927ca-1754-4830-a4d1-3cb7b112f683 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:56.188526 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-409927ca-1754-4830-a4d1-3cb7b112f683 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:56.213921 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-409927ca-1754-4830-a4d1-3cb7b112f683 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:56.215332 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-409927ca-1754-4830-a4d1-3cb7b112f683 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:56.217397 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-409927ca-1754-4830-a4d1-3cb7b112f683 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:56.233146 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-409927ca-1754-4830-a4d1-3cb7b112f683 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:56.241688 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4bb7d223-3b77-4c9a-ac65-1faa3fbbd3ab tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:56.251559 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4bb7d223-3b77-4c9a-ac65-1faa3fbbd3ab tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec" status: 200 len: 1219 microversion: 2.1 time: 0.209716 May 23 17:19:56.255624 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 116/247] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:56 2022] GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec => generated 1219 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:56.707046 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-409927ca-1754-4830-a4d1-3cb7b112f683 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:56.728073 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-409927ca-1754-4830-a4d1-3cb7b112f683 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:56.737752 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-409927ca-1754-4830-a4d1-3cb7b112f683 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:56.737752 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-409927ca-1754-4830-a4d1-3cb7b112f683 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1724 microversion: 2.20 time: 0.559506 May 23 17:19:56.737752 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 132/248] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:19:56 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1724 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:19:56.832091 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c97cccf3-71f3-48f0-ab75-9d3b5f76c72a tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:56.834852 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c97cccf3-71f3-48f0-ab75-9d3b5f76c72a tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: ee74a742-e7c0-4541-8302-b655a0d946ee] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:56.853752 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c97cccf3-71f3-48f0-ab75-9d3b5f76c72a tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:56.854492 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c97cccf3-71f3-48f0-ab75-9d3b5f76c72a tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:56.854993 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c97cccf3-71f3-48f0-ab75-9d3b5f76c72a tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:56.855431 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c97cccf3-71f3-48f0-ab75-9d3b5f76c72a tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:57.192588 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-981abc5a-58c9-4d50-81a2-9629c22dcbf0 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:57.194960 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-981abc5a-58c9-4d50-81a2-9629c22dcbf0 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2391a78f-53ee-4e0f-b59f-5978e3ee93a0] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:57.212874 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-981abc5a-58c9-4d50-81a2-9629c22dcbf0 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:57.213344 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-981abc5a-58c9-4d50-81a2-9629c22dcbf0 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:57.214142 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-981abc5a-58c9-4d50-81a2-9629c22dcbf0 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:57.214590 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-981abc5a-58c9-4d50-81a2-9629c22dcbf0 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:57.306547 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c97cccf3-71f3-48f0-ab75-9d3b5f76c72a tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:57.319111 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c97cccf3-71f3-48f0-ab75-9d3b5f76c72a tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee" status: 200 len: 1314 microversion: 2.1 time: 0.491570 May 23 17:19:57.324831 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 117/249] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:56 2022] GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee => generated 1314 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:57.346272 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-21fe2199-3152-4395-acc9-86b629ddc675 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:57.347038 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-21fe2199-3152-4395-acc9-86b629ddc675 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 6664de84-4c36-42da-9577-594b6bc73fec] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:57.358509 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-21fe2199-3152-4395-acc9-86b629ddc675 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:57.366807 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-21fe2199-3152-4395-acc9-86b629ddc675 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:57.370870 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-21fe2199-3152-4395-acc9-86b629ddc675 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:57.371506 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-21fe2199-3152-4395-acc9-86b629ddc675 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:57.529352 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-21fe2199-3152-4395-acc9-86b629ddc675 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:57.542438 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-21fe2199-3152-4395-acc9-86b629ddc675 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec" status: 200 len: 1215 microversion: 2.1 time: 0.214313 May 23 17:19:57.544929 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 118/250] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:57 2022] GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec => generated 1215 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:57.601800 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-981abc5a-58c9-4d50-81a2-9629c22dcbf0 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:57.643036 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-981abc5a-58c9-4d50-81a2-9629c22dcbf0 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0" status: 200 len: 1264 microversion: 2.1 time: 0.455666 May 23 17:19:57.649877 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 133/251] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:57 2022] GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0 => generated 1264 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:57.755073 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b338b99a-d473-44ed-926e-a855cfa72819 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:57.756142 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b338b99a-d473-44ed-926e-a855cfa72819 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:57.765083 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b338b99a-d473-44ed-926e-a855cfa72819 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:57.770469 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b338b99a-d473-44ed-926e-a855cfa72819 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:57.771970 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b338b99a-d473-44ed-926e-a855cfa72819 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:57.772499 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b338b99a-d473-44ed-926e-a855cfa72819 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:58.128295 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b338b99a-d473-44ed-926e-a855cfa72819 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:58.172880 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b338b99a-d473-44ed-926e-a855cfa72819 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:58.174557 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b338b99a-d473-44ed-926e-a855cfa72819 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:58.175742 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b338b99a-d473-44ed-926e-a855cfa72819 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1724 microversion: 2.20 time: 0.424817 May 23 17:19:58.176488 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 119/252] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:19:57 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1724 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:19:58.335296 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c04bcf5e-68b1-4929-820d-e52faccc9b96 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:58.336670 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c04bcf5e-68b1-4929-820d-e52faccc9b96 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: ee74a742-e7c0-4541-8302-b655a0d946ee] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:58.348831 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c04bcf5e-68b1-4929-820d-e52faccc9b96 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:58.349666 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c04bcf5e-68b1-4929-820d-e52faccc9b96 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:58.350623 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c04bcf5e-68b1-4929-820d-e52faccc9b96 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:58.351312 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c04bcf5e-68b1-4929-820d-e52faccc9b96 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:58.560466 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c17ea82c-22b3-4264-bb33-d51c1674eae0 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:58.561362 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c17ea82c-22b3-4264-bb33-d51c1674eae0 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 6664de84-4c36-42da-9577-594b6bc73fec] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:58.576010 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c17ea82c-22b3-4264-bb33-d51c1674eae0 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:58.585122 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c17ea82c-22b3-4264-bb33-d51c1674eae0 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:58.588843 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c17ea82c-22b3-4264-bb33-d51c1674eae0 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:58.593270 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c17ea82c-22b3-4264-bb33-d51c1674eae0 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:58.689839 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-c04bcf5e-68b1-4929-820d-e52faccc9b96 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:58.701088 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c04bcf5e-68b1-4929-820d-e52faccc9b96 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee" status: 200 len: 1314 microversion: 2.1 time: 0.369422 May 23 17:19:58.720838 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 134/253] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:58 2022] GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:58.741623 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-98a86580-e1c3-40f4-9710-fd055f4c67c9 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:58.743278 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-98a86580-e1c3-40f4-9710-fd055f4c67c9 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2391a78f-53ee-4e0f-b59f-5978e3ee93a0] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:58.763449 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-98a86580-e1c3-40f4-9710-fd055f4c67c9 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:58.764440 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-98a86580-e1c3-40f4-9710-fd055f4c67c9 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:58.766292 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-98a86580-e1c3-40f4-9710-fd055f4c67c9 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:58.767038 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-98a86580-e1c3-40f4-9710-fd055f4c67c9 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:58.788212 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c17ea82c-22b3-4264-bb33-d51c1674eae0 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:58.799941 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c17ea82c-22b3-4264-bb33-d51c1674eae0 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec" status: 200 len: 1279 microversion: 2.1 time: 0.243355 May 23 17:19:58.806361 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 120/254] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:58 2022] GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec => generated 1279 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:59.024037 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-98a86580-e1c3-40f4-9710-fd055f4c67c9 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:59.036776 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-98a86580-e1c3-40f4-9710-fd055f4c67c9 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0" status: 200 len: 1264 microversion: 2.1 time: 0.314722 May 23 17:19:59.037382 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 135/255] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:58 2022] GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0 => generated 1264 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:19:59.210757 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0b154e98-6744-4054-97a4-e5bad78a9ae0 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:59.211942 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0b154e98-6744-4054-97a4-e5bad78a9ae0 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:59.226502 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-5b301923-89e2-4284-94c2-4ad9d4c7edd3 req-af7409b8-066a-4734-a6f6-4f4cf2af19c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee74a742-e7c0-4541-8302-b655a0d946ee", "tag": "d9f16a90-40a7-4ac7-b105-adca11f0f1e1"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:19:59.261632 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0b154e98-6744-4054-97a4-e5bad78a9ae0 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:59.263385 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0b154e98-6744-4054-97a4-e5bad78a9ae0 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:59.265417 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0b154e98-6744-4054-97a4-e5bad78a9ae0 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:59.266133 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0b154e98-6744-4054-97a4-e5bad78a9ae0 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:59.277979 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-5b301923-89e2-4284-94c2-4ad9d4c7edd3 req-af7409b8-066a-4734-a6f6-4f4cf2af19c0 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:59.278567 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-5b301923-89e2-4284-94c2-4ad9d4c7edd3 req-af7409b8-066a-4734-a6f6-4f4cf2af19c0 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:59.314360 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-5b301923-89e2-4284-94c2-4ad9d4c7edd3 req-af7409b8-066a-4734-a6f6-4f4cf2af19c0 service nova] Creating event network-changed:d9f16a90-40a7-4ac7-b105-adca11f0f1e1 for instance ee74a742-e7c0-4541-8302-b655a0d946ee on hv-cinder-84299 May 23 17:19:59.324667 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-5b301923-89e2-4284-94c2-4ad9d4c7edd3 req-af7409b8-066a-4734-a6f6-4f4cf2af19c0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110182 May 23 17:19:59.325986 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 136/256] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:19:59.446460 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-cd53b9d2-32cb-4841-94ca-e6ab7e6465ac tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Action: 'create', calling method: .version_select at 0x7fd7a09a84c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1635307418", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdf8e1MvoYraAig8mRZzWaH5xaQ9PUtmnbZlTxG59+qB0YN7aykYVewJrTGPA+szFByxlFyThNjUij1tjIHXBiNViTaSOvUHZX0Eq4HHSYIWtuYTDb3o/qSDo5a6ntLGA=="}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:19:59.478279 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-cd53b9d2-32cb-4841-94ca-e6ab7e6465ac tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Getting quotas for project 0cc6a8ff9f92432ba9433b78a948d042. Resources: {'key_pairs'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 17:19:59.497448 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-cd53b9d2-32cb-4841-94ca-e6ab7e6465ac tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Getting quotas for user 63d18c022a19438d88562ef8e8c3fbce and project 0cc6a8ff9f92432ba9433b78a948d042. Resources: {'key_pairs'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 17:19:59.540349 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-cd53b9d2-32cb-4841-94ca-e6ab7e6465ac tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.098852 May 23 17:19:59.541579 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 137/257] 10.222.0.46 () {60 vars in 1158 bytes} [Mon May 23 17:19:59 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 17:19:59.653193 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0b154e98-6744-4054-97a4-e5bad78a9ae0 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:59.663302 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0b154e98-6744-4054-97a4-e5bad78a9ae0 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:59.669469 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0b154e98-6744-4054-97a4-e5bad78a9ae0 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:19:59.670768 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0b154e98-6744-4054-97a4-e5bad78a9ae0 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1724 microversion: 2.20 time: 0.474066 May 23 17:19:59.683956 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 121/258] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:19:59 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1724 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:19:59.709256 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-cf62e7a2-8f7b-4fa4-a478-134baa12d04c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-571719687", "imageRef": "064de78e-a551-452b-b231-ab7bcfdd49d5", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1635307418", "networks": [{"uuid": "b846d605-8c12-4387-8da9-fb1f1e55b795"}]}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:19:59.737129 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b42e1f16-2128-4793-b748-8b26e8537266 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:19:59.738310 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b42e1f16-2128-4793-b748-8b26e8537266 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: ee74a742-e7c0-4541-8302-b655a0d946ee] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:19:59.745170 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b42e1f16-2128-4793-b748-8b26e8537266 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:59.745617 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b42e1f16-2128-4793-b748-8b26e8537266 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:59.746379 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b42e1f16-2128-4793-b748-8b26e8537266 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:19:59.757324 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b42e1f16-2128-4793-b748-8b26e8537266 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:19:59.792355 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.network.neutron [None req-cf62e7a2-8f7b-4fa4-a478-134baa12d04c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] validate_networks() for [('b846d605-8c12-4387-8da9-fb1f1e55b795', None, None, None, None, None)] {{(pid=117910) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 17:20:00.037694 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b42e1f16-2128-4793-b748-8b26e8537266 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:00.048390 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b42e1f16-2128-4793-b748-8b26e8537266 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee" status: 200 len: 1314 microversion: 2.1 time: 0.315106 May 23 17:20:00.049011 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 122/259] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:19:59 2022] GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:00.063180 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9a26c51b-00c4-4549-ba60-0c2d49de2b50 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:00.064088 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9a26c51b-00c4-4549-ba60-0c2d49de2b50 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 6664de84-4c36-42da-9577-594b6bc73fec] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:00.070496 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9a26c51b-00c4-4549-ba60-0c2d49de2b50 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:00.071161 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9a26c51b-00c4-4549-ba60-0c2d49de2b50 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:00.072547 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9a26c51b-00c4-4549-ba60-0c2d49de2b50 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:00.073229 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9a26c51b-00c4-4549-ba60-0c2d49de2b50 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:00.227299 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9a26c51b-00c4-4549-ba60-0c2d49de2b50 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:00.236696 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9a26c51b-00c4-4549-ba60-0c2d49de2b50 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec" status: 200 len: 1277 microversion: 2.1 time: 0.177900 May 23 17:20:00.237584 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 123/260] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:00 2022] GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec => generated 1277 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:00.258023 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e07af2d5-0371-46c8-b266-960163d90742 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:00.258750 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e07af2d5-0371-46c8-b266-960163d90742 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2391a78f-53ee-4e0f-b59f-5978e3ee93a0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:00.267353 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e07af2d5-0371-46c8-b266-960163d90742 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:00.270067 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e07af2d5-0371-46c8-b266-960163d90742 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:00.275313 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e07af2d5-0371-46c8-b266-960163d90742 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:00.277146 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e07af2d5-0371-46c8-b266-960163d90742 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:00.506871 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e07af2d5-0371-46c8-b266-960163d90742 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:00.519837 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e07af2d5-0371-46c8-b266-960163d90742 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0" status: 200 len: 1264 microversion: 2.1 time: 0.280557 May 23 17:20:00.524261 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-cf62e7a2-8f7b-4fa4-a478-134baa12d04c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Flavor limits 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 17:20:00.525515 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-cf62e7a2-8f7b-4fa4-a478-134baa12d04c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Image limits 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 17:20:00.526489 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-cf62e7a2-8f7b-4fa4-a478-134baa12d04c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Flavor pref 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 17:20:00.527151 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-cf62e7a2-8f7b-4fa4-a478-134baa12d04c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Image pref 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 17:20:00.527877 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-cf62e7a2-8f7b-4fa4-a478-134baa12d04c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 17:20:00.535581 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 124/261] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:00 2022] GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0 => generated 1264 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:00.544875 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cf62e7a2-8f7b-4fa4-a478-134baa12d04c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:00.546365 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cf62e7a2-8f7b-4fa4-a478-134baa12d04c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:00.550156 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cf62e7a2-8f7b-4fa4-a478-134baa12d04c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:00.550855 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cf62e7a2-8f7b-4fa4-a478-134baa12d04c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:00.572837 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-cf62e7a2-8f7b-4fa4-a478-134baa12d04c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Getting quotas for project 0cc6a8ff9f92432ba9433b78a948d042. Resources: {'cores', 'instances', 'ram'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 17:20:00.579139 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-cf62e7a2-8f7b-4fa4-a478-134baa12d04c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Getting quotas for user 63d18c022a19438d88562ef8e8c3fbce and project 0cc6a8ff9f92432ba9433b78a948d042. Resources: {'cores', 'instances', 'ram'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 17:20:00.593555 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-cf62e7a2-8f7b-4fa4-a478-134baa12d04c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Going to run 1 instances... {{(pid=117910) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 17:20:00.596346 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-cf62e7a2-8f7b-4fa4-a478-134baa12d04c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='064de78e-a551-452b-b231-ab7bcfdd49d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117910) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 17:20:00.671469 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-cf62e7a2-8f7b-4fa4-a478-134baa12d04c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.966220 May 23 17:20:00.679122 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 138/262] 10.222.0.46 () {60 vars in 1146 bytes} [Mon May 23 17:19:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 17:20:00.679917 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-58c6b871-16c0-4ec3-a0ff-651e70ca9fee req-b8b4a919-a69e-4064-8b15-bcb20bbc0c1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2391a78f-53ee-4e0f-b59f-5978e3ee93a0", "name": "network-vif-plugged", "status": "completed", "tag": "d1a4e9d0-3b46-48b5-8e5d-788e05f3721f"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:20:00.695653 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-bc40c5a3-ead4-497c-84ff-383c0854c1cb tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:00.696733 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-bc40c5a3-ead4-497c-84ff-383c0854c1cb tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:00.709701 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:00.719649 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-58c6b871-16c0-4ec3-a0ff-651e70ca9fee req-b8b4a919-a69e-4064-8b15-bcb20bbc0c1e service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:00.720121 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-58c6b871-16c0-4ec3-a0ff-651e70ca9fee req-b8b4a919-a69e-4064-8b15-bcb20bbc0c1e service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:00.750922 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-58c6b871-16c0-4ec3-a0ff-651e70ca9fee req-b8b4a919-a69e-4064-8b15-bcb20bbc0c1e service nova] Creating event network-vif-plugged:d1a4e9d0-3b46-48b5-8e5d-788e05f3721f for instance 2391a78f-53ee-4e0f-b59f-5978e3ee93a0 on hv-cinder-84299 May 23 17:20:00.758782 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-58c6b871-16c0-4ec3-a0ff-651e70ca9fee req-b8b4a919-a69e-4064-8b15-bcb20bbc0c1e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100705 May 23 17:20:00.765411 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 125/263] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 17:20:00.798689 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1d674d19-061c-4688-8953-2749800ca094 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:00.799651 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1d674d19-061c-4688-8953-2749800ca094 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:00.823977 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1d674d19-061c-4688-8953-2749800ca094 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:00.824434 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1d674d19-061c-4688-8953-2749800ca094 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:00.825338 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1d674d19-061c-4688-8953-2749800ca094 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:00.825829 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1d674d19-061c-4688-8953-2749800ca094 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:00.875683 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-bc40c5a3-ead4-497c-84ff-383c0854c1cb tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:00.883377 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-bc40c5a3-ead4-497c-84ff-383c0854c1cb tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1258 microversion: 2.1 time: 0.202183 May 23 17:20:00.893967 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 139/264] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:00 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1258 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:01.065644 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-883c28c4-bfee-4d4b-8117-404d7c2e7e00 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:01.066287 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-883c28c4-bfee-4d4b-8117-404d7c2e7e00 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: ee74a742-e7c0-4541-8302-b655a0d946ee] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:01.079001 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1d674d19-061c-4688-8953-2749800ca094 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:01.086699 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-883c28c4-bfee-4d4b-8117-404d7c2e7e00 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:01.087450 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-883c28c4-bfee-4d4b-8117-404d7c2e7e00 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:01.088306 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-883c28c4-bfee-4d4b-8117-404d7c2e7e00 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:01.088990 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-883c28c4-bfee-4d4b-8117-404d7c2e7e00 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:01.103050 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1d674d19-061c-4688-8953-2749800ca094 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:01.104702 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1d674d19-061c-4688-8953-2749800ca094 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:01.111710 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1d674d19-061c-4688-8953-2749800ca094 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1724 microversion: 2.20 time: 0.344134 May 23 17:20:01.112426 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 126/265] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:20:00 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1724 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:20:01.256186 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ca38f575-98cd-4282-a0d3-ae4cd0a65c95 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:01.256975 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ca38f575-98cd-4282-a0d3-ae4cd0a65c95 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 6664de84-4c36-42da-9577-594b6bc73fec] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:01.267883 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-883c28c4-bfee-4d4b-8117-404d7c2e7e00 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:01.280189 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ca38f575-98cd-4282-a0d3-ae4cd0a65c95 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:01.283049 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ca38f575-98cd-4282-a0d3-ae4cd0a65c95 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:01.284276 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ca38f575-98cd-4282-a0d3-ae4cd0a65c95 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:01.284997 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ca38f575-98cd-4282-a0d3-ae4cd0a65c95 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:01.288671 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-883c28c4-bfee-4d4b-8117-404d7c2e7e00 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee" status: 200 len: 1314 microversion: 2.1 time: 0.217833 May 23 17:20:01.290381 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 140/266] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:01 2022] GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:20:01.383755 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-7931b9fa-d817-4da8-a934-ef439af900f9 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-121492252", "imageRef": "99870172-61a4-4218-9407-6a6da3fb5c83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "257b1a33-3119-4811-9395-bd6f39340e2d"}], "security_groups": [{"name": "tempest-securitygroup--651052708"}], "key_name": "tempest-keypair-1190045884", "user_data": "}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:20:01.442147 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ca38f575-98cd-4282-a0d3-ae4cd0a65c95 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:01.452162 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ca38f575-98cd-4282-a0d3-ae4cd0a65c95 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec" status: 200 len: 1319 microversion: 2.1 time: 0.202008 May 23 17:20:01.452935 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 127/267] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:01 2022] GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:01.489056 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.network.neutron [None req-7931b9fa-d817-4da8-a934-ef439af900f9 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] validate_networks() for [('257b1a33-3119-4811-9395-bd6f39340e2d', None, None, None, None, None)] {{(pid=117910) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 17:20:01.551524 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a1d04b91-0dcd-4874-9e04-c30576599a16 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:01.552136 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a1d04b91-0dcd-4874-9e04-c30576599a16 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2391a78f-53ee-4e0f-b59f-5978e3ee93a0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:01.561248 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a1d04b91-0dcd-4874-9e04-c30576599a16 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:01.561872 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a1d04b91-0dcd-4874-9e04-c30576599a16 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:01.566928 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a1d04b91-0dcd-4874-9e04-c30576599a16 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:01.567369 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a1d04b91-0dcd-4874-9e04-c30576599a16 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:01.850118 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a1d04b91-0dcd-4874-9e04-c30576599a16 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:01.867422 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a1d04b91-0dcd-4874-9e04-c30576599a16 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0" status: 200 len: 1264 microversion: 2.1 time: 0.319717 May 23 17:20:01.868351 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 128/268] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:01 2022] GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0 => generated 1264 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:20:01.901509 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8f226c78-acb7-447f-ba56-91b73dd50ccc tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:01.902122 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8f226c78-acb7-447f-ba56-91b73dd50ccc tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:01.911240 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8f226c78-acb7-447f-ba56-91b73dd50ccc tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:01.911686 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8f226c78-acb7-447f-ba56-91b73dd50ccc tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:01.912543 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8f226c78-acb7-447f-ba56-91b73dd50ccc tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:01.912908 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8f226c78-acb7-447f-ba56-91b73dd50ccc tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:02.164371 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8f226c78-acb7-447f-ba56-91b73dd50ccc tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:02.180224 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8f226c78-acb7-447f-ba56-91b73dd50ccc tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1254 microversion: 2.1 time: 0.282526 May 23 17:20:02.181094 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 129/269] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:01 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1254 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:02.193773 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0e6c7f76-1f18-446c-962d-a75833d61880 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:02.194710 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0e6c7f76-1f18-446c-962d-a75833d61880 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:02.203459 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=90,nova_api:UPDATE=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:02.219942 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-7931b9fa-d817-4da8-a934-ef439af900f9 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Flavor limits 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 17:20:02.221147 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-7931b9fa-d817-4da8-a934-ef439af900f9 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Image limits 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 17:20:02.221850 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-7931b9fa-d817-4da8-a934-ef439af900f9 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Flavor pref 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 17:20:02.222607 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-7931b9fa-d817-4da8-a934-ef439af900f9 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Image pref 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 17:20:02.223417 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-7931b9fa-d817-4da8-a934-ef439af900f9 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 17:20:02.224185 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e6c7f76-1f18-446c-962d-a75833d61880 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:02.224892 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e6c7f76-1f18-446c-962d-a75833d61880 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:02.225811 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e6c7f76-1f18-446c-962d-a75833d61880 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:02.228214 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e6c7f76-1f18-446c-962d-a75833d61880 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:02.240248 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7931b9fa-d817-4da8-a934-ef439af900f9 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:02.241477 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7931b9fa-d817-4da8-a934-ef439af900f9 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:02.242680 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7931b9fa-d817-4da8-a934-ef439af900f9 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:02.243347 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7931b9fa-d817-4da8-a934-ef439af900f9 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:02.278532 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-7931b9fa-d817-4da8-a934-ef439af900f9 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Getting quotas for project 9b1709bec893431599352cb6e470cf76. Resources: {'cores', 'instances', 'ram'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 17:20:02.294866 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-7931b9fa-d817-4da8-a934-ef439af900f9 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Getting quotas for user 8c5d1f4f0bec40ad8e325f8f92739b4d and project 9b1709bec893431599352cb6e470cf76. Resources: {'cores', 'instances', 'ram'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 17:20:02.328467 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-7931b9fa-d817-4da8-a934-ef439af900f9 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Going to run 1 instances... {{(pid=117910) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 17:20:02.331730 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-7931b9fa-d817-4da8-a934-ef439af900f9 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99870172-61a4-4218-9407-6a6da3fb5c83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117910) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 17:20:02.386206 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-7931b9fa-d817-4da8-a934-ef439af900f9 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.006990 May 23 17:20:02.392909 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 141/270] 10.222.0.46 () {60 vars in 1146 bytes} [Mon May 23 17:20:01 2022] POST /compute/v2.1/servers => generated 408 bytes in 1014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 23 17:20:02.398320 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-6b51109b-7f4c-4d2f-b67b-f73c11a71fb8 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:02.399291 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-6b51109b-7f4c-4d2f-b67b-f73c11a71fb8 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: ee74a742-e7c0-4541-8302-b655a0d946ee] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:02.406598 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6b51109b-7f4c-4d2f-b67b-f73c11a71fb8 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:02.407315 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6b51109b-7f4c-4d2f-b67b-f73c11a71fb8 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:02.408778 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6b51109b-7f4c-4d2f-b67b-f73c11a71fb8 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:02.409398 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6b51109b-7f4c-4d2f-b67b-f73c11a71fb8 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:02.452898 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0e6c7f76-1f18-446c-962d-a75833d61880 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:02.464196 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0e6c7f76-1f18-446c-962d-a75833d61880 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:02.465923 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0e6c7f76-1f18-446c-962d-a75833d61880 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:02.467365 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0e6c7f76-1f18-446c-962d-a75833d61880 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1745 microversion: 2.20 time: 0.280214 May 23 17:20:02.468282 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 130/271] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:20:02 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1745 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:20:02.472850 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ca3c3942-a2dc-4e54-a8fc-b2f1f09400fc tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:02.473624 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ca3c3942-a2dc-4e54-a8fc-b2f1f09400fc tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:02.562317 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ca3c3942-a2dc-4e54-a8fc-b2f1f09400fc tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:02.570490 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ca3c3942-a2dc-4e54-a8fc-b2f1f09400fc tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1245 microversion: 2.1 time: 0.101057 May 23 17:20:02.571654 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 131/272] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:02 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1245 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:02.593351 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-308222e0-452b-46e7-917e-0213e9fc8ff3 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:02.596876 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-308222e0-452b-46e7-917e-0213e9fc8ff3 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 6664de84-4c36-42da-9577-594b6bc73fec] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:02.616840 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-308222e0-452b-46e7-917e-0213e9fc8ff3 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:02.617577 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-308222e0-452b-46e7-917e-0213e9fc8ff3 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:02.618548 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-308222e0-452b-46e7-917e-0213e9fc8ff3 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:02.619111 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-308222e0-452b-46e7-917e-0213e9fc8ff3 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:02.652307 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-6b51109b-7f4c-4d2f-b67b-f73c11a71fb8 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:02.662675 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-6b51109b-7f4c-4d2f-b67b-f73c11a71fb8 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee" status: 200 len: 1314 microversion: 2.1 time: 0.268410 May 23 17:20:02.664530 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 142/273] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:02 2022] GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:02.769520 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-b561c362-0cc9-4ab5-ab1c-61bdc34708b5 req-3ba4e3b7-6614-4171-9033-1e2133597547 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6664de84-4c36-42da-9577-594b6bc73fec", "tag": "6e8a38a1-d3f7-4b87-84d5-ede2178f2cd2"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:20:02.782023 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-b561c362-0cc9-4ab5-ab1c-61bdc34708b5 req-3ba4e3b7-6614-4171-9033-1e2133597547 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:02.783634 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-b561c362-0cc9-4ab5-ab1c-61bdc34708b5 req-3ba4e3b7-6614-4171-9033-1e2133597547 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:02.799392 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-b561c362-0cc9-4ab5-ab1c-61bdc34708b5 req-3ba4e3b7-6614-4171-9033-1e2133597547 service nova] Creating event network-changed:6e8a38a1-d3f7-4b87-84d5-ede2178f2cd2 for instance 6664de84-4c36-42da-9577-594b6bc73fec on hv-cinder-84299 May 23 17:20:02.805781 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-b561c362-0cc9-4ab5-ab1c-61bdc34708b5 req-3ba4e3b7-6614-4171-9033-1e2133597547 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044561 May 23 17:20:02.817123 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 143/274] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 17:20:02.865983 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-308222e0-452b-46e7-917e-0213e9fc8ff3 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:02.877287 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-308222e0-452b-46e7-917e-0213e9fc8ff3 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec" status: 200 len: 1319 microversion: 2.1 time: 0.303843 May 23 17:20:02.877789 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 132/275] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:02 2022] GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:02.893202 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-6a8b6b3d-d39a-4149-8973-b960f90dcdea tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:02.895705 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-6a8b6b3d-d39a-4149-8973-b960f90dcdea tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2391a78f-53ee-4e0f-b59f-5978e3ee93a0] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:02.903635 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6a8b6b3d-d39a-4149-8973-b960f90dcdea tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:02.904455 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6a8b6b3d-d39a-4149-8973-b960f90dcdea tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:02.905860 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6a8b6b3d-d39a-4149-8973-b960f90dcdea tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:02.906488 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6a8b6b3d-d39a-4149-8973-b960f90dcdea tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:03.200942 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d3680972-dec3-4f86-a57a-6b226f85853f tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:03.202108 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d3680972-dec3-4f86-a57a-6b226f85853f tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:03.211890 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d3680972-dec3-4f86-a57a-6b226f85853f tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:03.212711 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d3680972-dec3-4f86-a57a-6b226f85853f tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:03.214149 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d3680972-dec3-4f86-a57a-6b226f85853f tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:03.214802 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d3680972-dec3-4f86-a57a-6b226f85853f tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:03.309191 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d3680972-dec3-4f86-a57a-6b226f85853f tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:03.320930 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d3680972-dec3-4f86-a57a-6b226f85853f tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1318 microversion: 2.1 time: 0.126717 May 23 17:20:03.330859 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 133/276] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:03 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1318 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:03.337994 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-6a8b6b3d-d39a-4149-8973-b960f90dcdea tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:03.346654 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-6a8b6b3d-d39a-4149-8973-b960f90dcdea tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0" status: 200 len: 1264 microversion: 2.1 time: 0.459037 May 23 17:20:03.348771 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 144/277] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:02 2022] GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0 => generated 1264 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:03.486252 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-bfe48480-c708-4e5d-8f9e-44f0fc527d6b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:03.486862 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-bfe48480-c708-4e5d-8f9e-44f0fc527d6b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:03.493116 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bfe48480-c708-4e5d-8f9e-44f0fc527d6b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:03.493558 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bfe48480-c708-4e5d-8f9e-44f0fc527d6b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:03.494318 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bfe48480-c708-4e5d-8f9e-44f0fc527d6b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:03.494745 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bfe48480-c708-4e5d-8f9e-44f0fc527d6b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:03.509401 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:03.587605 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-07119677-2177-42c3-a1d4-dcd38681eca0 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:03.588215 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-07119677-2177-42c3-a1d4-dcd38681eca0 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:03.595335 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-07119677-2177-42c3-a1d4-dcd38681eca0 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:03.595998 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-07119677-2177-42c3-a1d4-dcd38681eca0 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:03.597005 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-07119677-2177-42c3-a1d4-dcd38681eca0 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:03.597444 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-07119677-2177-42c3-a1d4-dcd38681eca0 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:03.623409 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-bfe48480-c708-4e5d-8f9e-44f0fc527d6b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:03.631626 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-bfe48480-c708-4e5d-8f9e-44f0fc527d6b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:03.633084 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-bfe48480-c708-4e5d-8f9e-44f0fc527d6b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:03.634240 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-bfe48480-c708-4e5d-8f9e-44f0fc527d6b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1745 microversion: 2.20 time: 0.152352 May 23 17:20:03.634806 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 134/278] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:20:03 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:20:03.671532 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-07119677-2177-42c3-a1d4-dcd38681eca0 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:03.679413 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-07119677-2177-42c3-a1d4-dcd38681eca0 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1249 microversion: 2.1 time: 0.095971 May 23 17:20:03.679988 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 145/279] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:03 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1249 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:03.682101 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9b899fe8-a1c7-4f13-b944-62b90a3d6c90 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:03.682713 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9b899fe8-a1c7-4f13-b944-62b90a3d6c90 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: ee74a742-e7c0-4541-8302-b655a0d946ee] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:03.690472 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9b899fe8-a1c7-4f13-b944-62b90a3d6c90 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:03.690985 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9b899fe8-a1c7-4f13-b944-62b90a3d6c90 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:03.691830 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9b899fe8-a1c7-4f13-b944-62b90a3d6c90 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:03.692330 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9b899fe8-a1c7-4f13-b944-62b90a3d6c90 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:03.827901 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9b899fe8-a1c7-4f13-b944-62b90a3d6c90 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:03.836504 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9b899fe8-a1c7-4f13-b944-62b90a3d6c90 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee" status: 200 len: 1314 microversion: 2.1 time: 0.158329 May 23 17:20:03.837324 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 135/280] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:03 2022] GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:03.895528 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-1beefa97-7eff-4076-8c6d-e87c24dcbaba tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:03.896171 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-1beefa97-7eff-4076-8c6d-e87c24dcbaba tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 6664de84-4c36-42da-9577-594b6bc73fec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:03.902263 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1beefa97-7eff-4076-8c6d-e87c24dcbaba tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:03.902711 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1beefa97-7eff-4076-8c6d-e87c24dcbaba tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:03.903581 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1beefa97-7eff-4076-8c6d-e87c24dcbaba tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:03.904179 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1beefa97-7eff-4076-8c6d-e87c24dcbaba tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:04.039147 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-1beefa97-7eff-4076-8c6d-e87c24dcbaba tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:04.042712 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=100 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:04.053395 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-1beefa97-7eff-4076-8c6d-e87c24dcbaba tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec" status: 200 len: 1319 microversion: 2.1 time: 0.160361 May 23 17:20:04.053395 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 146/281] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:03 2022] GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:04.342247 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d63922fe-02d5-4d2f-a038-7b961f3f782d tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:04.343251 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d63922fe-02d5-4d2f-a038-7b961f3f782d tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:04.353602 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d63922fe-02d5-4d2f-a038-7b961f3f782d tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:04.354337 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d63922fe-02d5-4d2f-a038-7b961f3f782d tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:04.355594 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d63922fe-02d5-4d2f-a038-7b961f3f782d tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:04.356329 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d63922fe-02d5-4d2f-a038-7b961f3f782d tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:04.363463 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b1d7be91-f662-41f0-92ac-ad2b239c1b74 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:04.364182 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-b1d7be91-f662-41f0-92ac-ad2b239c1b74 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2391a78f-53ee-4e0f-b59f-5978e3ee93a0] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:04.370834 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b1d7be91-f662-41f0-92ac-ad2b239c1b74 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:04.371403 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b1d7be91-f662-41f0-92ac-ad2b239c1b74 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:04.372447 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b1d7be91-f662-41f0-92ac-ad2b239c1b74 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:04.372982 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b1d7be91-f662-41f0-92ac-ad2b239c1b74 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:04.419954 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d63922fe-02d5-4d2f-a038-7b961f3f782d tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:04.427777 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d63922fe-02d5-4d2f-a038-7b961f3f782d tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1318 microversion: 2.1 time: 0.092200 May 23 17:20:04.428383 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 136/282] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:04 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1318 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:04.532462 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b1d7be91-f662-41f0-92ac-ad2b239c1b74 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:04.543939 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b1d7be91-f662-41f0-92ac-ad2b239c1b74 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0" status: 200 len: 1264 microversion: 2.1 time: 0.184613 May 23 17:20:04.544761 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 147/283] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:04 2022] GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0 => generated 1264 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:04.656052 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6721ad1e-15fd-404a-a078-0c0056308328 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:04.657037 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6721ad1e-15fd-404a-a078-0c0056308328 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:04.665900 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6721ad1e-15fd-404a-a078-0c0056308328 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:04.666487 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6721ad1e-15fd-404a-a078-0c0056308328 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:04.667730 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6721ad1e-15fd-404a-a078-0c0056308328 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:04.668535 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6721ad1e-15fd-404a-a078-0c0056308328 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:04.696637 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b25a5c52-eb58-4d52-992b-18daee8db6e3 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:04.697235 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-b25a5c52-eb58-4d52-992b-18daee8db6e3 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:04.704093 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b25a5c52-eb58-4d52-992b-18daee8db6e3 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:04.704567 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b25a5c52-eb58-4d52-992b-18daee8db6e3 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:04.705369 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b25a5c52-eb58-4d52-992b-18daee8db6e3 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:04.705804 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b25a5c52-eb58-4d52-992b-18daee8db6e3 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:04.790952 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b25a5c52-eb58-4d52-992b-18daee8db6e3 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:04.799092 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b25a5c52-eb58-4d52-992b-18daee8db6e3 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1249 microversion: 2.1 time: 0.106258 May 23 17:20:04.799678 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 148/284] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:04 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1249 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:04.832581 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6721ad1e-15fd-404a-a078-0c0056308328 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:04.840577 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6721ad1e-15fd-404a-a078-0c0056308328 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:04.842743 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6721ad1e-15fd-404a-a078-0c0056308328 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:04.846029 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6721ad1e-15fd-404a-a078-0c0056308328 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1745 microversion: 2.20 time: 0.195638 May 23 17:20:04.846713 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 137/285] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:20:04 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1745 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:20:04.853688 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-8ab65ef9-e460-4f0b-a0fb-185783b5ff8b tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:04.854302 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-8ab65ef9-e460-4f0b-a0fb-185783b5ff8b tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: ee74a742-e7c0-4541-8302-b655a0d946ee] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:04.860948 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8ab65ef9-e460-4f0b-a0fb-185783b5ff8b tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:04.861411 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8ab65ef9-e460-4f0b-a0fb-185783b5ff8b tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:04.862166 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8ab65ef9-e460-4f0b-a0fb-185783b5ff8b tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:04.862602 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8ab65ef9-e460-4f0b-a0fb-185783b5ff8b tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:04.991073 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-8ab65ef9-e460-4f0b-a0fb-185783b5ff8b tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:05.003064 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-8ab65ef9-e460-4f0b-a0fb-185783b5ff8b tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee" status: 200 len: 1314 microversion: 2.1 time: 0.152959 May 23 17:20:05.003872 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 149/286] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:04 2022] GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:05.071491 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3d8dbf9f-5072-4ecc-be0e-344589ee3870 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:05.072104 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3d8dbf9f-5072-4ecc-be0e-344589ee3870 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 6664de84-4c36-42da-9577-594b6bc73fec] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:05.078536 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3d8dbf9f-5072-4ecc-be0e-344589ee3870 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:05.078981 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3d8dbf9f-5072-4ecc-be0e-344589ee3870 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:05.079738 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3d8dbf9f-5072-4ecc-be0e-344589ee3870 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:05.080169 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3d8dbf9f-5072-4ecc-be0e-344589ee3870 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:05.229701 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3d8dbf9f-5072-4ecc-be0e-344589ee3870 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:05.238267 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3d8dbf9f-5072-4ecc-be0e-344589ee3870 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec" status: 200 len: 1319 microversion: 2.1 time: 0.170641 May 23 17:20:05.238984 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 138/287] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:05 2022] GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:05.444802 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-1514f6c1-1436-43d9-afb1-55741a560e62 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:05.445291 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-1514f6c1-1436-43d9-afb1-55741a560e62 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:05.451753 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1514f6c1-1436-43d9-afb1-55741a560e62 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:05.452194 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1514f6c1-1436-43d9-afb1-55741a560e62 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:05.452984 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1514f6c1-1436-43d9-afb1-55741a560e62 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:05.453408 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1514f6c1-1436-43d9-afb1-55741a560e62 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:05.515330 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-1514f6c1-1436-43d9-afb1-55741a560e62 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:05.522915 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-1514f6c1-1436-43d9-afb1-55741a560e62 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1318 microversion: 2.1 time: 0.082124 May 23 17:20:05.525742 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 150/288] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:05 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1318 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:05.566806 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-47ba6cc1-2060-4d7d-88d9-52c2e531d1c9 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:05.567638 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-47ba6cc1-2060-4d7d-88d9-52c2e531d1c9 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2391a78f-53ee-4e0f-b59f-5978e3ee93a0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:05.574513 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-47ba6cc1-2060-4d7d-88d9-52c2e531d1c9 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:05.574974 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-47ba6cc1-2060-4d7d-88d9-52c2e531d1c9 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:05.575917 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-47ba6cc1-2060-4d7d-88d9-52c2e531d1c9 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:05.576351 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-47ba6cc1-2060-4d7d-88d9-52c2e531d1c9 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:05.816530 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d60f7eae-3be4-40f1-8640-c4dc51bbf801 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:05.817893 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d60f7eae-3be4-40f1-8640-c4dc51bbf801 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:05.834391 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d60f7eae-3be4-40f1-8640-c4dc51bbf801 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:05.835671 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d60f7eae-3be4-40f1-8640-c4dc51bbf801 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:05.837439 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d60f7eae-3be4-40f1-8640-c4dc51bbf801 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:05.840823 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d60f7eae-3be4-40f1-8640-c4dc51bbf801 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:05.851795 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-47ba6cc1-2060-4d7d-88d9-52c2e531d1c9 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:05.863146 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-47ba6cc1-2060-4d7d-88d9-52c2e531d1c9 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0" status: 200 len: 1264 microversion: 2.1 time: 0.300895 May 23 17:20:05.864532 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 139/289] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:05 2022] GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0 => generated 1264 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:05.869650 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4ffdf71f-8af7-414d-9b95-1647aae83016 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:05.870518 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4ffdf71f-8af7-414d-9b95-1647aae83016 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:05.877747 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4ffdf71f-8af7-414d-9b95-1647aae83016 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:05.878206 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4ffdf71f-8af7-414d-9b95-1647aae83016 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:05.878977 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4ffdf71f-8af7-414d-9b95-1647aae83016 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:05.879412 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4ffdf71f-8af7-414d-9b95-1647aae83016 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:05.896336 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=4 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:05.907664 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d60f7eae-3be4-40f1-8640-c4dc51bbf801 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:05.915311 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d60f7eae-3be4-40f1-8640-c4dc51bbf801 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1241 microversion: 2.1 time: 0.103795 May 23 17:20:05.915998 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 151/290] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:05 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1241 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:06.020248 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-ed6364af-4ce1-44e3-9175-271a11c3b3e7 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:06.021209 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-ed6364af-4ce1-44e3-9175-271a11c3b3e7 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: ee74a742-e7c0-4541-8302-b655a0d946ee] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:06.022446 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4ffdf71f-8af7-414d-9b95-1647aae83016 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:06.028193 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ed6364af-4ce1-44e3-9175-271a11c3b3e7 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:06.029665 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ed6364af-4ce1-44e3-9175-271a11c3b3e7 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:06.030875 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ed6364af-4ce1-44e3-9175-271a11c3b3e7 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:06.031455 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4ffdf71f-8af7-414d-9b95-1647aae83016 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:06.031673 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ed6364af-4ce1-44e3-9175-271a11c3b3e7 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:06.033278 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4ffdf71f-8af7-414d-9b95-1647aae83016 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:06.034991 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4ffdf71f-8af7-414d-9b95-1647aae83016 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1745 microversion: 2.20 time: 0.168852 May 23 17:20:06.043488 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 140/291] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:20:05 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:20:06.184178 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ed6364af-4ce1-44e3-9175-271a11c3b3e7 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:06.195528 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-ed6364af-4ce1-44e3-9175-271a11c3b3e7 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee" status: 200 len: 1314 microversion: 2.1 time: 0.179583 May 23 17:20:06.196404 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 152/292] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:06 2022] GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:20:06.255226 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-01997c29-b6da-4c21-b33f-beea6a101ab9 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:06.255977 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-01997c29-b6da-4c21-b33f-beea6a101ab9 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 6664de84-4c36-42da-9577-594b6bc73fec] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:06.263212 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-01997c29-b6da-4c21-b33f-beea6a101ab9 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:06.263728 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-01997c29-b6da-4c21-b33f-beea6a101ab9 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:06.264595 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-01997c29-b6da-4c21-b33f-beea6a101ab9 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:06.265095 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-01997c29-b6da-4c21-b33f-beea6a101ab9 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:06.517537 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-01997c29-b6da-4c21-b33f-beea6a101ab9 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:06.525733 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-01997c29-b6da-4c21-b33f-beea6a101ab9 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec" status: 200 len: 1319 microversion: 2.1 time: 0.274377 May 23 17:20:06.526619 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 141/293] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:06 2022] GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec => generated 1319 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:06.539655 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-492cfe05-1041-4b5a-87be-5bc514e9d4f6 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:06.540274 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-492cfe05-1041-4b5a-87be-5bc514e9d4f6 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:06.546840 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-492cfe05-1041-4b5a-87be-5bc514e9d4f6 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:06.547946 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-492cfe05-1041-4b5a-87be-5bc514e9d4f6 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:06.549007 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-492cfe05-1041-4b5a-87be-5bc514e9d4f6 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:06.549612 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-492cfe05-1041-4b5a-87be-5bc514e9d4f6 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:06.620851 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-492cfe05-1041-4b5a-87be-5bc514e9d4f6 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:06.630297 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-492cfe05-1041-4b5a-87be-5bc514e9d4f6 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1316 microversion: 2.1 time: 0.094379 May 23 17:20:06.631002 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 153/294] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:06 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1316 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:06.883407 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-56d45352-82e1-43db-bc9b-39ca2fd40baf tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:06.885050 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-56d45352-82e1-43db-bc9b-39ca2fd40baf tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2391a78f-53ee-4e0f-b59f-5978e3ee93a0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:06.898715 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-56d45352-82e1-43db-bc9b-39ca2fd40baf tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:06.899469 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-56d45352-82e1-43db-bc9b-39ca2fd40baf tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:06.902049 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-56d45352-82e1-43db-bc9b-39ca2fd40baf tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:06.902703 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-56d45352-82e1-43db-bc9b-39ca2fd40baf tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:06.934510 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-dfce5d8a-3f3a-447d-8e46-bc26809e520f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:06.935281 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-dfce5d8a-3f3a-447d-8e46-bc26809e520f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:06.950995 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-dfce5d8a-3f3a-447d-8e46-bc26809e520f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:06.954994 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-dfce5d8a-3f3a-447d-8e46-bc26809e520f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:06.957147 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-dfce5d8a-3f3a-447d-8e46-bc26809e520f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:06.959426 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-dfce5d8a-3f3a-447d-8e46-bc26809e520f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:07.097402 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-dfce5d8a-3f3a-447d-8e46-bc26809e520f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:07.108475 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-dfce5d8a-3f3a-447d-8e46-bc26809e520f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1305 microversion: 2.1 time: 0.179587 May 23 17:20:07.109113 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 154/295] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:06 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1305 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:20:07.122787 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d72bcb82-8c1c-4eb1-8420-6f26d025e0b9 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:07.123938 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d72bcb82-8c1c-4eb1-8420-6f26d025e0b9 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:07.133789 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d72bcb82-8c1c-4eb1-8420-6f26d025e0b9 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:07.134944 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d72bcb82-8c1c-4eb1-8420-6f26d025e0b9 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:07.136462 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d72bcb82-8c1c-4eb1-8420-6f26d025e0b9 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:07.137202 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d72bcb82-8c1c-4eb1-8420-6f26d025e0b9 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:07.166552 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-56d45352-82e1-43db-bc9b-39ca2fd40baf tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:07.177202 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-56d45352-82e1-43db-bc9b-39ca2fd40baf tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0" status: 200 len: 1264 microversion: 2.1 time: 0.298919 May 23 17:20:07.188206 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 142/296] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:06 2022] GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0 => generated 1264 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:07.221769 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-74833003-e435-4861-908c-554af619a979 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:07.222570 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-74833003-e435-4861-908c-554af619a979 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: ee74a742-e7c0-4541-8302-b655a0d946ee] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:07.229180 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-74833003-e435-4861-908c-554af619a979 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:07.234389 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-74833003-e435-4861-908c-554af619a979 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:07.235927 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-74833003-e435-4861-908c-554af619a979 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:07.236558 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-74833003-e435-4861-908c-554af619a979 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:07.831586 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d72bcb82-8c1c-4eb1-8420-6f26d025e0b9 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:07.844140 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d72bcb82-8c1c-4eb1-8420-6f26d025e0b9 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:07.846712 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d72bcb82-8c1c-4eb1-8420-6f26d025e0b9 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:07.850945 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d72bcb82-8c1c-4eb1-8420-6f26d025e0b9 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1740 microversion: 2.20 time: 0.740813 May 23 17:20:07.854393 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 155/297] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:20:07 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1740 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:20:07.868870 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2bf6178c-07ac-403a-8a76-05a7b8c4d48a tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:07.870245 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2bf6178c-07ac-403a-8a76-05a7b8c4d48a tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 6664de84-4c36-42da-9577-594b6bc73fec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:07.885422 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2bf6178c-07ac-403a-8a76-05a7b8c4d48a tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:07.886401 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2bf6178c-07ac-403a-8a76-05a7b8c4d48a tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:07.888549 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2bf6178c-07ac-403a-8a76-05a7b8c4d48a tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:07.889261 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2bf6178c-07ac-403a-8a76-05a7b8c4d48a tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:08.000704 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-74833003-e435-4861-908c-554af619a979 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:08.011445 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-74833003-e435-4861-908c-554af619a979 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee" status: 200 len: 1314 microversion: 2.1 time: 0.802694 May 23 17:20:08.015673 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 143/298] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:07 2022] GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee => generated 1314 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:08.024108 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0e5422d3-2dad-47e0-abb7-0207ebf749b7 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:08.031878 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0e5422d3-2dad-47e0-abb7-0207ebf749b7 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:08.058311 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e5422d3-2dad-47e0-abb7-0207ebf749b7 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:08.059270 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e5422d3-2dad-47e0-abb7-0207ebf749b7 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:08.060232 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e5422d3-2dad-47e0-abb7-0207ebf749b7 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:08.060907 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e5422d3-2dad-47e0-abb7-0207ebf749b7 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:08.250586 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2bf6178c-07ac-403a-8a76-05a7b8c4d48a tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:08.259183 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2bf6178c-07ac-403a-8a76-05a7b8c4d48a tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec" status: 200 len: 1319 microversion: 2.1 time: 0.403235 May 23 17:20:08.261806 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 156/299] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:07 2022] GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec => generated 1319 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:08.274472 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-fe27d7a8-9d72-4541-bdbd-2c2cfe1486cb req-27085127-fcd3-475a-a694-7205b68b5aeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4273c3a-0aba-4184-b088-2feaea1b1091", "name": "network-vif-plugged", "status": "completed", "tag": "0c234a65-eea7-4bdf-ac00-34147e4abec0"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:20:08.298290 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-fe27d7a8-9d72-4541-bdbd-2c2cfe1486cb req-27085127-fcd3-475a-a694-7205b68b5aeb service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:08.299281 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-fe27d7a8-9d72-4541-bdbd-2c2cfe1486cb req-27085127-fcd3-475a-a694-7205b68b5aeb service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:08.329979 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-fe27d7a8-9d72-4541-bdbd-2c2cfe1486cb req-27085127-fcd3-475a-a694-7205b68b5aeb service nova] Creating event network-vif-plugged:0c234a65-eea7-4bdf-ac00-34147e4abec0 for instance f4273c3a-0aba-4184-b088-2feaea1b1091 on hv-cinder-84299 May 23 17:20:08.340096 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-fe27d7a8-9d72-4541-bdbd-2c2cfe1486cb req-27085127-fcd3-475a-a694-7205b68b5aeb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075838 May 23 17:20:08.343192 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 157/300] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:20:08.358246 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-ec9808c8-e381-4e9d-a6f7-5fe279b06793 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:08.361149 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-ec9808c8-e381-4e9d-a6f7-5fe279b06793 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:08.377340 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ec9808c8-e381-4e9d-a6f7-5fe279b06793 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:08.380468 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ec9808c8-e381-4e9d-a6f7-5fe279b06793 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:08.385860 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ec9808c8-e381-4e9d-a6f7-5fe279b06793 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:08.387574 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ec9808c8-e381-4e9d-a6f7-5fe279b06793 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:08.432449 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0e5422d3-2dad-47e0-abb7-0207ebf749b7 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:08.456366 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0e5422d3-2dad-47e0-abb7-0207ebf749b7 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1358 microversion: 2.1 time: 0.434829 May 23 17:20:08.457068 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 144/301] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:08 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1358 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:08.471622 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8f647967-924f-45ab-8354-20f66cb5658c tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:08.472262 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8f647967-924f-45ab-8354-20f66cb5658c tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2391a78f-53ee-4e0f-b59f-5978e3ee93a0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:08.496990 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ec9808c8-e381-4e9d-a6f7-5fe279b06793 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:08.506493 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-ec9808c8-e381-4e9d-a6f7-5fe279b06793 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1303 microversion: 2.1 time: 0.159429 May 23 17:20:08.507419 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 158/302] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:08 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1303 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:08.507671 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8f647967-924f-45ab-8354-20f66cb5658c tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:08.508129 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8f647967-924f-45ab-8354-20f66cb5658c tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:08.508942 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8f647967-924f-45ab-8354-20f66cb5658c tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:08.510521 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8f647967-924f-45ab-8354-20f66cb5658c tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:08.744956 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8f647967-924f-45ab-8354-20f66cb5658c tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:08.763529 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8f647967-924f-45ab-8354-20f66cb5658c tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0" status: 200 len: 1450 microversion: 2.1 time: 0.304384 May 23 17:20:08.777551 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 145/303] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:08 2022] GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0 => generated 1450 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:08.781229 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-4928b3dc-0854-430f-92d5-cae6ca2d625d tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:08.782130 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-4928b3dc-0854-430f-92d5-cae6ca2d625d tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2391a78f-53ee-4e0f-b59f-5978e3ee93a0] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:08.813744 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4928b3dc-0854-430f-92d5-cae6ca2d625d tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:08.814548 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4928b3dc-0854-430f-92d5-cae6ca2d625d tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:08.815418 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4928b3dc-0854-430f-92d5-cae6ca2d625d tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:08.815931 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4928b3dc-0854-430f-92d5-cae6ca2d625d tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:08.837517 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-2f6feb37-3581-4cf0-93b6-19dd5d01f74a req-993efde7-5dc5-45d0-b6b7-7dabb9a39136 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c6c849e-492f-4bd4-91d8-f1622420a3d2", "tag": "b64de995-4ddd-4471-a42a-480203d490ce"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:20:08.891519 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-2f6feb37-3581-4cf0-93b6-19dd5d01f74a req-993efde7-5dc5-45d0-b6b7-7dabb9a39136 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:08.892993 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-2f6feb37-3581-4cf0-93b6-19dd5d01f74a req-993efde7-5dc5-45d0-b6b7-7dabb9a39136 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:08.942321 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-2f6feb37-3581-4cf0-93b6-19dd5d01f74a req-993efde7-5dc5-45d0-b6b7-7dabb9a39136 service nova] Creating event network-changed:b64de995-4ddd-4471-a42a-480203d490ce for instance 7c6c849e-492f-4bd4-91d8-f1622420a3d2 on hv-cinder-84299 May 23 17:20:08.958150 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-2f6feb37-3581-4cf0-93b6-19dd5d01f74a req-993efde7-5dc5-45d0-b6b7-7dabb9a39136 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142972 May 23 17:20:08.961450 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 146/304] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:20:08.972470 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-25937a24-e35b-4045-b02f-78efa275cf33 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:08.973640 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-25937a24-e35b-4045-b02f-78efa275cf33 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:08.982526 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-25937a24-e35b-4045-b02f-78efa275cf33 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:08.983738 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-25937a24-e35b-4045-b02f-78efa275cf33 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:08.984308 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-25937a24-e35b-4045-b02f-78efa275cf33 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:08.985080 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-25937a24-e35b-4045-b02f-78efa275cf33 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:09.150276 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-4928b3dc-0854-430f-92d5-cae6ca2d625d tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:09.159051 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-4928b3dc-0854-430f-92d5-cae6ca2d625d tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0" status: 200 len: 1450 microversion: 2.1 time: 0.381952 May 23 17:20:09.161566 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 159/305] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:08 2022] GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0 => generated 1450 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:20:09.168205 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-9c169bc4-9a12-4ae1-bfac-bc3de2ee4f7e tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:09.175345 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-9c169bc4-9a12-4ae1-bfac-bc3de2ee4f7e tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: ee74a742-e7c0-4541-8302-b655a0d946ee] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:09.199075 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9c169bc4-9a12-4ae1-bfac-bc3de2ee4f7e tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:09.200925 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9c169bc4-9a12-4ae1-bfac-bc3de2ee4f7e tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:09.205782 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9c169bc4-9a12-4ae1-bfac-bc3de2ee4f7e tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:09.206459 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9c169bc4-9a12-4ae1-bfac-bc3de2ee4f7e tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:09.270420 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-25937a24-e35b-4045-b02f-78efa275cf33 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:09.279799 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-25937a24-e35b-4045-b02f-78efa275cf33 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:09.281341 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-25937a24-e35b-4045-b02f-78efa275cf33 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:09.282513 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-25937a24-e35b-4045-b02f-78efa275cf33 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1740 microversion: 2.20 time: 0.318975 May 23 17:20:09.283075 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 147/306] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:20:08 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1740 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:20:09.309873 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-cc4e67cc-a47c-46f5-b28e-262b06c89149 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:09.315434 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-cc4e67cc-a47c-46f5-b28e-262b06c89149 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 6664de84-4c36-42da-9577-594b6bc73fec] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:09.327586 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cc4e67cc-a47c-46f5-b28e-262b06c89149 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:09.330164 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cc4e67cc-a47c-46f5-b28e-262b06c89149 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:09.331884 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cc4e67cc-a47c-46f5-b28e-262b06c89149 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:09.333652 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cc4e67cc-a47c-46f5-b28e-262b06c89149 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:09.549903 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9c169bc4-9a12-4ae1-bfac-bc3de2ee4f7e tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:09.560524 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-9c169bc4-9a12-4ae1-bfac-bc3de2ee4f7e tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee" status: 200 len: 1314 microversion: 2.1 time: 0.397014 May 23 17:20:09.568754 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 160/307] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:09 2022] GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:09.591101 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-cc4e67cc-a47c-46f5-b28e-262b06c89149 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:09.599707 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-cc4e67cc-a47c-46f5-b28e-262b06c89149 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec" status: 200 len: 1319 microversion: 2.1 time: 0.312231 May 23 17:20:09.601139 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2a5e475f-fe35-4782-bea5-c11af298ee32 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:09.601902 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2a5e475f-fe35-4782-bea5-c11af298ee32 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:09.608279 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2a5e475f-fe35-4782-bea5-c11af298ee32 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:09.608695 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2a5e475f-fe35-4782-bea5-c11af298ee32 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:09.609477 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2a5e475f-fe35-4782-bea5-c11af298ee32 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:09.609914 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2a5e475f-fe35-4782-bea5-c11af298ee32 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:09.610888 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 148/308] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:09 2022] GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec => generated 1319 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:09.622340 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1f4ce1da-a552-41e9-85dc-819aa63beaf8 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:09.622994 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1f4ce1da-a552-41e9-85dc-819aa63beaf8 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:09.634347 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1f4ce1da-a552-41e9-85dc-819aa63beaf8 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:09.634871 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1f4ce1da-a552-41e9-85dc-819aa63beaf8 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:09.635589 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1f4ce1da-a552-41e9-85dc-819aa63beaf8 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:09.636014 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1f4ce1da-a552-41e9-85dc-819aa63beaf8 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:09.797926 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1f4ce1da-a552-41e9-85dc-819aa63beaf8 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:09.806383 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1f4ce1da-a552-41e9-85dc-819aa63beaf8 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1303 microversion: 2.1 time: 0.194371 May 23 17:20:09.807282 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 149/309] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:09 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1303 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:09.937980 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2a5e475f-fe35-4782-bea5-c11af298ee32 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:09.949751 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2a5e475f-fe35-4782-bea5-c11af298ee32 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1358 microversion: 2.1 time: 0.371090 May 23 17:20:09.950681 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 161/310] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:09 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1358 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:10.302867 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5b386cf2-c0fb-45ad-8dc0-f0aa271dbf27 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:10.303625 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5b386cf2-c0fb-45ad-8dc0-f0aa271dbf27 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:10.318221 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5b386cf2-c0fb-45ad-8dc0-f0aa271dbf27 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:10.318660 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5b386cf2-c0fb-45ad-8dc0-f0aa271dbf27 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:10.319461 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5b386cf2-c0fb-45ad-8dc0-f0aa271dbf27 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:10.319887 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5b386cf2-c0fb-45ad-8dc0-f0aa271dbf27 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:10.396664 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-d01364d4-734b-45b4-9d76-eedd458209ff req-2b43cfae-5142-40e6-bbb5-2dd2fbbbac64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee74a742-e7c0-4541-8302-b655a0d946ee", "name": "network-vif-plugged", "status": "completed", "tag": "d9f16a90-40a7-4ac7-b105-adca11f0f1e1"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:20:10.412573 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-d01364d4-734b-45b4-9d76-eedd458209ff req-2b43cfae-5142-40e6-bbb5-2dd2fbbbac64 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:10.413049 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-d01364d4-734b-45b4-9d76-eedd458209ff req-2b43cfae-5142-40e6-bbb5-2dd2fbbbac64 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:10.444260 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-d01364d4-734b-45b4-9d76-eedd458209ff req-2b43cfae-5142-40e6-bbb5-2dd2fbbbac64 service nova] Creating event network-vif-plugged:d9f16a90-40a7-4ac7-b105-adca11f0f1e1 for instance ee74a742-e7c0-4541-8302-b655a0d946ee on hv-cinder-84299 May 23 17:20:10.472573 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-d01364d4-734b-45b4-9d76-eedd458209ff req-2b43cfae-5142-40e6-bbb5-2dd2fbbbac64 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077027 May 23 17:20:10.473637 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 162/311] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:20:10.586359 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-f76b9e0f-2b86-479c-8f10-bfed83a1e44b tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:10.587073 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-f76b9e0f-2b86-479c-8f10-bfed83a1e44b tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: ee74a742-e7c0-4541-8302-b655a0d946ee] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:10.604738 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f76b9e0f-2b86-479c-8f10-bfed83a1e44b tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:10.605190 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f76b9e0f-2b86-479c-8f10-bfed83a1e44b tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:10.606555 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f76b9e0f-2b86-479c-8f10-bfed83a1e44b tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:10.607142 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f76b9e0f-2b86-479c-8f10-bfed83a1e44b tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:10.863875 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5b386cf2-c0fb-45ad-8dc0-f0aa271dbf27 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:10.875636 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5b386cf2-c0fb-45ad-8dc0-f0aa271dbf27 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:10.878104 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5b386cf2-c0fb-45ad-8dc0-f0aa271dbf27 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:10.880797 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5b386cf2-c0fb-45ad-8dc0-f0aa271dbf27 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1740 microversion: 2.20 time: 0.581346 May 23 17:20:10.892012 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 150/312] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:20:10 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1740 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:20:10.899775 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-449349b9-875d-40b2-a6a6-4930c0277a62 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:10.900391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-449349b9-875d-40b2-a6a6-4930c0277a62 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 6664de84-4c36-42da-9577-594b6bc73fec] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:10.918639 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-449349b9-875d-40b2-a6a6-4930c0277a62 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:10.918997 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-449349b9-875d-40b2-a6a6-4930c0277a62 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:10.919919 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-449349b9-875d-40b2-a6a6-4930c0277a62 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:10.920498 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-449349b9-875d-40b2-a6a6-4930c0277a62 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:11.010963 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-f76b9e0f-2b86-479c-8f10-bfed83a1e44b tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:11.031359 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-f76b9e0f-2b86-479c-8f10-bfed83a1e44b tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee" status: 200 len: 1314 microversion: 2.1 time: 0.449852 May 23 17:20:11.036975 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 163/313] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:10 2022] GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee => generated 1314 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:20:11.042200 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-ed3aade8-f6f4-481b-a828-61f8a4d155aa tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:11.048110 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-ed3aade8-f6f4-481b-a828-61f8a4d155aa tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:11.065502 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ed3aade8-f6f4-481b-a828-61f8a4d155aa tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:11.066301 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ed3aade8-f6f4-481b-a828-61f8a4d155aa tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:11.067449 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ed3aade8-f6f4-481b-a828-61f8a4d155aa tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:11.068082 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ed3aade8-f6f4-481b-a828-61f8a4d155aa tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:11.317433 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-449349b9-875d-40b2-a6a6-4930c0277a62 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:11.321027 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:11.330074 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-449349b9-875d-40b2-a6a6-4930c0277a62 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec" status: 200 len: 1319 microversion: 2.1 time: 0.447145 May 23 17:20:11.330668 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 151/314] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:10 2022] GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec => generated 1319 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:11.346582 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f3578103-ab8b-4091-83ef-4b5501e193ac tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:11.347483 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f3578103-ab8b-4091-83ef-4b5501e193ac tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:11.359453 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f3578103-ab8b-4091-83ef-4b5501e193ac tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:11.365777 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f3578103-ab8b-4091-83ef-4b5501e193ac tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:11.367289 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f3578103-ab8b-4091-83ef-4b5501e193ac tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:11.373977 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f3578103-ab8b-4091-83ef-4b5501e193ac tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:11.378832 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ed3aade8-f6f4-481b-a828-61f8a4d155aa tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:11.386327 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=100 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:11.393216 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-ed3aade8-f6f4-481b-a828-61f8a4d155aa tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1303 microversion: 2.1 time: 0.354365 May 23 17:20:11.395876 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 164/315] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:11 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1303 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:11.901085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b3eb4f7f-481a-407c-805f-ab1aa73a920e tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:11.901928 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-b3eb4f7f-481a-407c-805f-ab1aa73a920e tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:11.916897 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b3eb4f7f-481a-407c-805f-ab1aa73a920e tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:11.919801 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b3eb4f7f-481a-407c-805f-ab1aa73a920e tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:11.924620 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b3eb4f7f-481a-407c-805f-ab1aa73a920e tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:11.929227 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b3eb4f7f-481a-407c-805f-ab1aa73a920e tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:12.126150 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f3578103-ab8b-4091-83ef-4b5501e193ac tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:12.135434 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f3578103-ab8b-4091-83ef-4b5501e193ac tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1358 microversion: 2.1 time: 0.799032 May 23 17:20:12.146551 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 152/316] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:11 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1358 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:12.152011 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-855a955d-e4d4-4db9-bb2b-2a981a6c2086 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:12.152964 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-855a955d-e4d4-4db9-bb2b-2a981a6c2086 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: ee74a742-e7c0-4541-8302-b655a0d946ee] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:12.160636 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-855a955d-e4d4-4db9-bb2b-2a981a6c2086 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:12.161309 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-855a955d-e4d4-4db9-bb2b-2a981a6c2086 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:12.163652 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-855a955d-e4d4-4db9-bb2b-2a981a6c2086 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:12.164403 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-855a955d-e4d4-4db9-bb2b-2a981a6c2086 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:12.258473 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=4 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:12.315061 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=24 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:12.566483 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=16 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:13.749233 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b3eb4f7f-481a-407c-805f-ab1aa73a920e tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:13.759180 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-855a955d-e4d4-4db9-bb2b-2a981a6c2086 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:13.764678 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b3eb4f7f-481a-407c-805f-ab1aa73a920e tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:13.770145 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b3eb4f7f-481a-407c-805f-ab1aa73a920e tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:13.774268 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-855a955d-e4d4-4db9-bb2b-2a981a6c2086 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee" status: 200 len: 1314 microversion: 2.1 time: 1.623658 May 23 17:20:13.774706 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b3eb4f7f-481a-407c-805f-ab1aa73a920e tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1740 microversion: 2.20 time: 1.877736 May 23 17:20:13.776161 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 153/317] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:12 2022] GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee => generated 1314 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:13.789183 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 165/318] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:20:11 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1740 bytes in 1893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 17:20:13.796282 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2c53cd31-5614-4110-85e5-9621becb30b0 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:13.797257 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2c53cd31-5614-4110-85e5-9621becb30b0 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 6664de84-4c36-42da-9577-594b6bc73fec] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:13.802094 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-6d6018fc-d317-48f8-809d-c5d87b57c90a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:13.803326 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-6d6018fc-d317-48f8-809d-c5d87b57c90a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:13.820831 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6d6018fc-d317-48f8-809d-c5d87b57c90a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:13.821297 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2c53cd31-5614-4110-85e5-9621becb30b0 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:13.821826 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6d6018fc-d317-48f8-809d-c5d87b57c90a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:13.822074 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2c53cd31-5614-4110-85e5-9621becb30b0 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:13.823450 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2c53cd31-5614-4110-85e5-9621becb30b0 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:13.824143 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2c53cd31-5614-4110-85e5-9621becb30b0 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:13.828821 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6d6018fc-d317-48f8-809d-c5d87b57c90a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:13.830260 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6d6018fc-d317-48f8-809d-c5d87b57c90a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:14.080418 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-6d6018fc-d317-48f8-809d-c5d87b57c90a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:14.088444 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-6d6018fc-d317-48f8-809d-c5d87b57c90a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1303 microversion: 2.1 time: 0.299052 May 23 17:20:14.099831 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 166/319] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:13 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1303 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:14.105165 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2b4dd9b5-4390-4731-ab0e-310a7bc46cc6 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:14.106062 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2b4dd9b5-4390-4731-ab0e-310a7bc46cc6 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:14.112753 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2b4dd9b5-4390-4731-ab0e-310a7bc46cc6 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:14.113580 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2b4dd9b5-4390-4731-ab0e-310a7bc46cc6 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:14.114591 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2b4dd9b5-4390-4731-ab0e-310a7bc46cc6 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:14.115232 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2b4dd9b5-4390-4731-ab0e-310a7bc46cc6 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:14.264460 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2c53cd31-5614-4110-85e5-9621becb30b0 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:14.280677 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2c53cd31-5614-4110-85e5-9621becb30b0 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec" status: 200 len: 1319 microversion: 2.1 time: 0.500154 May 23 17:20:14.292524 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 154/320] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:13 2022] GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec => generated 1319 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:14.504591 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2b4dd9b5-4390-4731-ab0e-310a7bc46cc6 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:14.516337 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2b4dd9b5-4390-4731-ab0e-310a7bc46cc6 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1358 microversion: 2.1 time: 0.414942 May 23 17:20:14.517133 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 167/321] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:14 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1358 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:14.800893 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-bf8a004a-303d-44bb-95c9-611198aa802b tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:14.802105 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-bf8a004a-303d-44bb-95c9-611198aa802b tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: ee74a742-e7c0-4541-8302-b655a0d946ee] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:14.805930 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e9744aae-a73f-441f-8536-6cf81fc822fa tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:14.806599 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-e9744aae-a73f-441f-8536-6cf81fc822fa tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:14.813880 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bf8a004a-303d-44bb-95c9-611198aa802b tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:14.815830 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bf8a004a-303d-44bb-95c9-611198aa802b tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:14.816723 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e9744aae-a73f-441f-8536-6cf81fc822fa tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:14.817262 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e9744aae-a73f-441f-8536-6cf81fc822fa tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:14.818059 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e9744aae-a73f-441f-8536-6cf81fc822fa tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:14.818688 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bf8a004a-303d-44bb-95c9-611198aa802b tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:14.819151 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bf8a004a-303d-44bb-95c9-611198aa802b tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:14.823003 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e9744aae-a73f-441f-8536-6cf81fc822fa tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:15.843349 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-bf8a004a-303d-44bb-95c9-611198aa802b tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:15.852217 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-bf8a004a-303d-44bb-95c9-611198aa802b tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee" status: 200 len: 1314 microversion: 2.1 time: 1.061466 May 23 17:20:15.856672 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 155/322] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:14 2022] GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee => generated 1314 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:15.864398 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5aa40dc5-9353-4f31-bd27-c303a107f985 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:15.869880 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5aa40dc5-9353-4f31-bd27-c303a107f985 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:15.872039 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e9744aae-a73f-441f-8536-6cf81fc822fa tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:15.882621 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5aa40dc5-9353-4f31-bd27-c303a107f985 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:15.886763 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5aa40dc5-9353-4f31-bd27-c303a107f985 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:15.888339 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5aa40dc5-9353-4f31-bd27-c303a107f985 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:15.889549 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5aa40dc5-9353-4f31-bd27-c303a107f985 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:15.904016 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e9744aae-a73f-441f-8536-6cf81fc822fa tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:15.911369 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e9744aae-a73f-441f-8536-6cf81fc822fa tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:15.920660 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-e9744aae-a73f-441f-8536-6cf81fc822fa tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1740 microversion: 2.20 time: 1.118489 May 23 17:20:15.939794 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 168/323] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:20:14 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1740 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:20:15.968158 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2d01e2e6-fab6-4307-bee7-b1dfc41d371a tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:15.972506 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2d01e2e6-fab6-4307-bee7-b1dfc41d371a tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 6664de84-4c36-42da-9577-594b6bc73fec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:16.025782 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2d01e2e6-fab6-4307-bee7-b1dfc41d371a tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:16.032038 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2d01e2e6-fab6-4307-bee7-b1dfc41d371a tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:16.032975 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2d01e2e6-fab6-4307-bee7-b1dfc41d371a tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:16.033426 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2d01e2e6-fab6-4307-bee7-b1dfc41d371a tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:16.149206 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5aa40dc5-9353-4f31-bd27-c303a107f985 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:16.160416 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5aa40dc5-9353-4f31-bd27-c303a107f985 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1303 microversion: 2.1 time: 0.299610 May 23 17:20:16.161278 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 156/324] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:15 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1303 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:16.169195 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1315715d-d9fa-48a8-93fa-ca2309500201 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:16.176169 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1315715d-d9fa-48a8-93fa-ca2309500201 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:16.189901 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1315715d-d9fa-48a8-93fa-ca2309500201 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:16.191875 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1315715d-d9fa-48a8-93fa-ca2309500201 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:16.193597 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1315715d-d9fa-48a8-93fa-ca2309500201 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:16.198628 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1315715d-d9fa-48a8-93fa-ca2309500201 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:16.608471 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2d01e2e6-fab6-4307-bee7-b1dfc41d371a tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:16.620759 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2d01e2e6-fab6-4307-bee7-b1dfc41d371a tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec" status: 200 len: 1319 microversion: 2.1 time: 0.676595 May 23 17:20:16.621559 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 169/325] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:15 2022] GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec => generated 1319 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:16.633100 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-7699fd81-6a9d-4891-8ad8-04086c5d4c00 req-e91553c9-c2af-43de-a2ee-0a5af25218fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2391a78f-53ee-4e0f-b59f-5978e3ee93a0", "tag": "d1a4e9d0-3b46-48b5-8e5d-788e05f3721f"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:20:16.658285 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-7699fd81-6a9d-4891-8ad8-04086c5d4c00 req-e91553c9-c2af-43de-a2ee-0a5af25218fd service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:16.659058 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-7699fd81-6a9d-4891-8ad8-04086c5d4c00 req-e91553c9-c2af-43de-a2ee-0a5af25218fd service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:16.696079 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-7699fd81-6a9d-4891-8ad8-04086c5d4c00 req-e91553c9-c2af-43de-a2ee-0a5af25218fd service nova] Creating event network-changed:d1a4e9d0-3b46-48b5-8e5d-788e05f3721f for instance 2391a78f-53ee-4e0f-b59f-5978e3ee93a0 on hv-cinder-84299 May 23 17:20:16.708454 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-7699fd81-6a9d-4891-8ad8-04086c5d4c00 req-e91553c9-c2af-43de-a2ee-0a5af25218fd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083979 May 23 17:20:16.712180 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 170/326] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:20:16.866676 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1315715d-d9fa-48a8-93fa-ca2309500201 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:16.873225 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-ab9e5769-8939-4422-81e9-ab02b40d4c9d tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:16.874628 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-ab9e5769-8939-4422-81e9-ab02b40d4c9d tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: ee74a742-e7c0-4541-8302-b655a0d946ee] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:16.885774 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1315715d-d9fa-48a8-93fa-ca2309500201 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1358 microversion: 2.1 time: 0.722613 May 23 17:20:16.886381 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 157/327] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:16 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1358 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:16.890802 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ab9e5769-8939-4422-81e9-ab02b40d4c9d tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:16.896724 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ab9e5769-8939-4422-81e9-ab02b40d4c9d tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:16.899319 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ab9e5769-8939-4422-81e9-ab02b40d4c9d tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:16.900169 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ab9e5769-8939-4422-81e9-ab02b40d4c9d tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:16.944543 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3522e690-d368-4f29-88a0-7849e346b1d2 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:16.945641 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3522e690-d368-4f29-88a0-7849e346b1d2 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:16.964881 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3522e690-d368-4f29-88a0-7849e346b1d2 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:16.968942 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3522e690-d368-4f29-88a0-7849e346b1d2 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:16.974679 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3522e690-d368-4f29-88a0-7849e346b1d2 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:16.978397 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3522e690-d368-4f29-88a0-7849e346b1d2 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:17.568092 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3522e690-d368-4f29-88a0-7849e346b1d2 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:17.581565 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3522e690-d368-4f29-88a0-7849e346b1d2 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:17.589756 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3522e690-d368-4f29-88a0-7849e346b1d2 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:17.598100 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3522e690-d368-4f29-88a0-7849e346b1d2 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1740 microversion: 2.20 time: 0.660993 May 23 17:20:17.600552 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 158/328] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:20:16 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1740 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 17:20:17.625154 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-acc1a5cd-321b-4e0c-a919-8cb90171c1f5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:17.625900 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-acc1a5cd-321b-4e0c-a919-8cb90171c1f5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:17.653430 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-acc1a5cd-321b-4e0c-a919-8cb90171c1f5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:17.655677 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-acc1a5cd-321b-4e0c-a919-8cb90171c1f5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:17.658251 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-acc1a5cd-321b-4e0c-a919-8cb90171c1f5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:17.663069 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-acc1a5cd-321b-4e0c-a919-8cb90171c1f5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:17.690287 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ab9e5769-8939-4422-81e9-ab02b40d4c9d tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:17.700564 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-ab9e5769-8939-4422-81e9-ab02b40d4c9d tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee" status: 200 len: 1497 microversion: 2.1 time: 0.832054 May 23 17:20:17.731659 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 171/329] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:16 2022] GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee => generated 1497 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:17.758580 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-49775775-1084-44ff-9ead-eab84e4a5076 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:17.759981 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-49775775-1084-44ff-9ead-eab84e4a5076 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 6664de84-4c36-42da-9577-594b6bc73fec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:17.772972 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-49775775-1084-44ff-9ead-eab84e4a5076 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:17.775367 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-49775775-1084-44ff-9ead-eab84e4a5076 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:17.776401 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-49775775-1084-44ff-9ead-eab84e4a5076 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:17.783204 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-49775775-1084-44ff-9ead-eab84e4a5076 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:17.891214 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-acc1a5cd-321b-4e0c-a919-8cb90171c1f5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:17.902818 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-acc1a5cd-321b-4e0c-a919-8cb90171c1f5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1303 microversion: 2.1 time: 0.298754 May 23 17:20:17.905788 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 159/330] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:17 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1303 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:17.916895 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f9d644fc-dd36-45a1-9941-45d449678598 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:17.917904 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f9d644fc-dd36-45a1-9941-45d449678598 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:17.931702 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f9d644fc-dd36-45a1-9941-45d449678598 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:17.934531 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f9d644fc-dd36-45a1-9941-45d449678598 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:17.937446 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f9d644fc-dd36-45a1-9941-45d449678598 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:17.938970 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f9d644fc-dd36-45a1-9941-45d449678598 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:18.749520 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f9d644fc-dd36-45a1-9941-45d449678598 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:18.758372 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f9d644fc-dd36-45a1-9941-45d449678598 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1358 microversion: 2.1 time: 0.848851 May 23 17:20:18.761279 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 160/331] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:17 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1358 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:18.774219 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-f4224fcd-9287-43f2-b7a1-b117bebc95b8 req-4aeaf5cd-e038-4e1f-84a0-eda34496f173 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6664de84-4c36-42da-9577-594b6bc73fec", "name": "network-vif-plugged", "status": "completed", "tag": "6e8a38a1-d3f7-4b87-84d5-ede2178f2cd2"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:20:18.807006 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-f4224fcd-9287-43f2-b7a1-b117bebc95b8 req-4aeaf5cd-e038-4e1f-84a0-eda34496f173 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:18.807472 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-f4224fcd-9287-43f2-b7a1-b117bebc95b8 req-4aeaf5cd-e038-4e1f-84a0-eda34496f173 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:18.852963 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-f4224fcd-9287-43f2-b7a1-b117bebc95b8 req-4aeaf5cd-e038-4e1f-84a0-eda34496f173 service nova] Creating event network-vif-plugged:6e8a38a1-d3f7-4b87-84d5-ede2178f2cd2 for instance 6664de84-4c36-42da-9577-594b6bc73fec on hv-cinder-84299 May 23 17:20:18.866917 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-f4224fcd-9287-43f2-b7a1-b117bebc95b8 req-4aeaf5cd-e038-4e1f-84a0-eda34496f173 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103039 May 23 17:20:18.866917 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 161/332] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:20:18.878890 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b34a6bd4-3adb-4419-9ff6-ebe0964b2379 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:18.879604 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b34a6bd4-3adb-4419-9ff6-ebe0964b2379 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:18.885573 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-49775775-1084-44ff-9ead-eab84e4a5076 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:18.888115 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b34a6bd4-3adb-4419-9ff6-ebe0964b2379 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:18.888935 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b34a6bd4-3adb-4419-9ff6-ebe0964b2379 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:18.889944 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b34a6bd4-3adb-4419-9ff6-ebe0964b2379 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:18.890664 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b34a6bd4-3adb-4419-9ff6-ebe0964b2379 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:18.909335 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-49775775-1084-44ff-9ead-eab84e4a5076 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec" status: 200 len: 1319 microversion: 2.1 time: 1.174312 May 23 17:20:18.909941 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 172/333] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:17 2022] GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec => generated 1319 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:18.937928 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-4a290c59-ee10-4404-be69-62c7df8651bf tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:18.938438 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-4a290c59-ee10-4404-be69-62c7df8651bf tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: ee74a742-e7c0-4541-8302-b655a0d946ee] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:18.979013 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4a290c59-ee10-4404-be69-62c7df8651bf tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:18.979469 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4a290c59-ee10-4404-be69-62c7df8651bf tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:18.980269 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4a290c59-ee10-4404-be69-62c7df8651bf tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:18.980741 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4a290c59-ee10-4404-be69-62c7df8651bf tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:19.111217 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-4a290c59-ee10-4404-be69-62c7df8651bf tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: ee74a742-e7c0-4541-8302-b655a0d946ee] Going to try to terminate instance {{(pid=117910) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 17:20:19.391355 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-4a290c59-ee10-4404-be69-62c7df8651bf tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee" status: 204 len: 0 microversion: 2.1 time: 0.480136 May 23 17:20:19.391945 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 173/334] 10.222.0.46 () {58 vars in 1238 bytes} [Mon May 23 17:20:18 2022] DELETE /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 17:20:19.416709 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-9fce4556-35c0-4a63-91e6-f6947ab2fc7a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:19.417910 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-9fce4556-35c0-4a63-91e6-f6947ab2fc7a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:19.437100 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9fce4556-35c0-4a63-91e6-f6947ab2fc7a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:19.440198 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9fce4556-35c0-4a63-91e6-f6947ab2fc7a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:19.441249 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9fce4556-35c0-4a63-91e6-f6947ab2fc7a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:19.444019 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9fce4556-35c0-4a63-91e6-f6947ab2fc7a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:19.535765 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b34a6bd4-3adb-4419-9ff6-ebe0964b2379 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:19.546972 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b34a6bd4-3adb-4419-9ff6-ebe0964b2379 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:19.548843 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b34a6bd4-3adb-4419-9ff6-ebe0964b2379 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:19.555035 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b34a6bd4-3adb-4419-9ff6-ebe0964b2379 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1740 microversion: 2.20 time: 0.684126 May 23 17:20:19.557088 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 162/335] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:20:18 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1740 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:20:19.563070 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-71c639c6-f546-4777-bd96-25c912d814b6 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:19.574386 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-71c639c6-f546-4777-bd96-25c912d814b6 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: ee74a742-e7c0-4541-8302-b655a0d946ee] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:19.599077 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-71c639c6-f546-4777-bd96-25c912d814b6 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:19.599993 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-71c639c6-f546-4777-bd96-25c912d814b6 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:19.601049 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-71c639c6-f546-4777-bd96-25c912d814b6 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:19.601696 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-71c639c6-f546-4777-bd96-25c912d814b6 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:19.893841 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9fce4556-35c0-4a63-91e6-f6947ab2fc7a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:19.903273 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-9fce4556-35c0-4a63-91e6-f6947ab2fc7a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1370 microversion: 2.1 time: 0.505976 May 23 17:20:19.914938 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 174/336] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:19 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1370 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:19.923131 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-52f4d42d-3f17-45f2-8c0d-ca7682197b87 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:19.924115 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-52f4d42d-3f17-45f2-8c0d-ca7682197b87 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:19.931879 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-52f4d42d-3f17-45f2-8c0d-ca7682197b87 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:19.932718 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-52f4d42d-3f17-45f2-8c0d-ca7682197b87 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:19.933730 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-52f4d42d-3f17-45f2-8c0d-ca7682197b87 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:19.934361 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-52f4d42d-3f17-45f2-8c0d-ca7682197b87 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:19.958271 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-71c639c6-f546-4777-bd96-25c912d814b6 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:19.969309 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-71c639c6-f546-4777-bd96-25c912d814b6 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee" status: 200 len: 1503 microversion: 2.1 time: 0.410780 May 23 17:20:19.969954 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 163/337] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:19 2022] GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee => generated 1503 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:19.992890 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-74e11214-8573-4725-b2dd-2b23f6abf228 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:19.993860 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-74e11214-8573-4725-b2dd-2b23f6abf228 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 6664de84-4c36-42da-9577-594b6bc73fec] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:20.007915 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-74e11214-8573-4725-b2dd-2b23f6abf228 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:20.008867 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-74e11214-8573-4725-b2dd-2b23f6abf228 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:20.009835 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-74e11214-8573-4725-b2dd-2b23f6abf228 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:20.010421 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-74e11214-8573-4725-b2dd-2b23f6abf228 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:20.269705 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-74e11214-8573-4725-b2dd-2b23f6abf228 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:20.279408 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-74e11214-8573-4725-b2dd-2b23f6abf228 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec" status: 200 len: 1319 microversion: 2.1 time: 0.296035 May 23 17:20:20.290823 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 164/338] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:19 2022] GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec => generated 1319 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:20.290924 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-52f4d42d-3f17-45f2-8c0d-ca7682197b87 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:20.312469 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-52f4d42d-3f17-45f2-8c0d-ca7682197b87 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1358 microversion: 2.1 time: 0.395006 May 23 17:20:20.313277 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 175/339] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:19 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1358 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:20.574418 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5bed30df-bda7-4508-80e7-9c2af29328d3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:20.576126 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5bed30df-bda7-4508-80e7-9c2af29328d3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:20.585316 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5bed30df-bda7-4508-80e7-9c2af29328d3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:20.586218 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5bed30df-bda7-4508-80e7-9c2af29328d3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:20.587207 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5bed30df-bda7-4508-80e7-9c2af29328d3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:20.587690 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5bed30df-bda7-4508-80e7-9c2af29328d3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:20.736924 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5bed30df-bda7-4508-80e7-9c2af29328d3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:20.745678 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5bed30df-bda7-4508-80e7-9c2af29328d3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:20.747413 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5bed30df-bda7-4508-80e7-9c2af29328d3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:20.748974 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5bed30df-bda7-4508-80e7-9c2af29328d3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1740 microversion: 2.20 time: 0.179207 May 23 17:20:20.750055 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 165/340] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:20:20 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:20:20.920462 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-49d0f142-3a90-4658-bb7c-8f3d0afa74a4 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:20.924227 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-49d0f142-3a90-4658-bb7c-8f3d0afa74a4 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:20.933652 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-49d0f142-3a90-4658-bb7c-8f3d0afa74a4 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:20.934104 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-49d0f142-3a90-4658-bb7c-8f3d0afa74a4 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:20.934870 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-49d0f142-3a90-4658-bb7c-8f3d0afa74a4 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:20.935433 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-49d0f142-3a90-4658-bb7c-8f3d0afa74a4 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:20.987761 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-fcba0d9b-0a23-4a7f-ba9b-5822feaa1881 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:20.988729 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-fcba0d9b-0a23-4a7f-ba9b-5822feaa1881 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: ee74a742-e7c0-4541-8302-b655a0d946ee] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:20.999590 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fcba0d9b-0a23-4a7f-ba9b-5822feaa1881 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:21.000435 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fcba0d9b-0a23-4a7f-ba9b-5822feaa1881 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:21.001643 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fcba0d9b-0a23-4a7f-ba9b-5822feaa1881 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:21.005520 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fcba0d9b-0a23-4a7f-ba9b-5822feaa1881 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:21.281247 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-49d0f142-3a90-4658-bb7c-8f3d0afa74a4 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:21.289628 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-49d0f142-3a90-4658-bb7c-8f3d0afa74a4 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1370 microversion: 2.1 time: 0.372962 May 23 17:20:21.292675 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 176/341] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:20 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1370 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:21.298196 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2d1ee144-e122-4354-88d5-d1884687118b tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:21.298991 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2d1ee144-e122-4354-88d5-d1884687118b tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 6664de84-4c36-42da-9577-594b6bc73fec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:21.308273 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2d1ee144-e122-4354-88d5-d1884687118b tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:21.308595 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2d1ee144-e122-4354-88d5-d1884687118b tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:21.309684 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2d1ee144-e122-4354-88d5-d1884687118b tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:21.310386 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2d1ee144-e122-4354-88d5-d1884687118b tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:21.316799 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-fcba0d9b-0a23-4a7f-ba9b-5822feaa1881 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:21.327724 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-fcba0d9b-0a23-4a7f-ba9b-5822feaa1881 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee" status: 200 len: 1503 microversion: 2.1 time: 0.343937 May 23 17:20:21.329203 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 166/342] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:20 2022] GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee => generated 1503 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:21.334123 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4bdadfaa-d921-4b12-8444-22afbd6ba654 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:21.334845 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4bdadfaa-d921-4b12-8444-22afbd6ba654 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:21.340887 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4bdadfaa-d921-4b12-8444-22afbd6ba654 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:21.341493 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4bdadfaa-d921-4b12-8444-22afbd6ba654 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:21.342343 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4bdadfaa-d921-4b12-8444-22afbd6ba654 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:21.342888 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4bdadfaa-d921-4b12-8444-22afbd6ba654 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:21.565502 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2d1ee144-e122-4354-88d5-d1884687118b tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:21.579397 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2d1ee144-e122-4354-88d5-d1884687118b tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec" status: 200 len: 1319 microversion: 2.1 time: 0.285418 May 23 17:20:21.580221 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 177/343] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:21 2022] GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec => generated 1319 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:21.597934 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4bdadfaa-d921-4b12-8444-22afbd6ba654 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:21.607274 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4bdadfaa-d921-4b12-8444-22afbd6ba654 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1358 microversion: 2.1 time: 0.276708 May 23 17:20:21.608764 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 167/344] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:21 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1358 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:21.768018 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-6f03d8fe-0429-44b0-a6af-d52e0307961d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:21.769040 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-6f03d8fe-0429-44b0-a6af-d52e0307961d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:21.771496 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:21.777578 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6f03d8fe-0429-44b0-a6af-d52e0307961d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:21.778287 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6f03d8fe-0429-44b0-a6af-d52e0307961d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:21.779431 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6f03d8fe-0429-44b0-a6af-d52e0307961d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:21.780066 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6f03d8fe-0429-44b0-a6af-d52e0307961d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:21.944447 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-6f03d8fe-0429-44b0-a6af-d52e0307961d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:21.955676 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-6f03d8fe-0429-44b0-a6af-d52e0307961d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:21.957621 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-6f03d8fe-0429-44b0-a6af-d52e0307961d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:21.959055 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-6f03d8fe-0429-44b0-a6af-d52e0307961d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1740 microversion: 2.20 time: 0.195007 May 23 17:20:21.970668 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 178/345] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:20:21 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1740 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 17:20:22.309245 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5057c5c9-4a00-4b70-baef-4268ea14941b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:22.309862 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5057c5c9-4a00-4b70-baef-4268ea14941b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:22.318669 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5057c5c9-4a00-4b70-baef-4268ea14941b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:22.319439 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5057c5c9-4a00-4b70-baef-4268ea14941b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:22.320215 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5057c5c9-4a00-4b70-baef-4268ea14941b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:22.320742 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5057c5c9-4a00-4b70-baef-4268ea14941b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:22.347666 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-603ef2ad-ed79-4ecf-af9d-76798c596eb6 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:22.348398 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-603ef2ad-ed79-4ecf-af9d-76798c596eb6 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: ee74a742-e7c0-4541-8302-b655a0d946ee] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:22.355152 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-603ef2ad-ed79-4ecf-af9d-76798c596eb6 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:22.356070 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-603ef2ad-ed79-4ecf-af9d-76798c596eb6 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:22.356923 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-603ef2ad-ed79-4ecf-af9d-76798c596eb6 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:22.357563 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-603ef2ad-ed79-4ecf-af9d-76798c596eb6 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:22.551125 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5057c5c9-4a00-4b70-baef-4268ea14941b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:22.555812 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-603ef2ad-ed79-4ecf-af9d-76798c596eb6 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:22.561898 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5057c5c9-4a00-4b70-baef-4268ea14941b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1370 microversion: 2.1 time: 0.256501 May 23 17:20:22.563084 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 168/346] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:22 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1370 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:22.569349 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-603ef2ad-ed79-4ecf-af9d-76798c596eb6 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee" status: 200 len: 1503 microversion: 2.1 time: 0.224940 May 23 17:20:22.571954 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 179/347] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:22 2022] GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee => generated 1503 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:22.595291 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b57e75f0-d7c2-4509-a660-b6b1a8f8f929 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:22.596402 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b57e75f0-d7c2-4509-a660-b6b1a8f8f929 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 6664de84-4c36-42da-9577-594b6bc73fec] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:22.603693 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b57e75f0-d7c2-4509-a660-b6b1a8f8f929 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:22.604897 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b57e75f0-d7c2-4509-a660-b6b1a8f8f929 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:22.607584 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b57e75f0-d7c2-4509-a660-b6b1a8f8f929 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:22.608733 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b57e75f0-d7c2-4509-a660-b6b1a8f8f929 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:22.611614 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:22.625045 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b214bab9-9f3f-49ff-8bf2-ecb9a081bdd8 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:22.625671 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-b214bab9-9f3f-49ff-8bf2-ecb9a081bdd8 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:22.631831 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b214bab9-9f3f-49ff-8bf2-ecb9a081bdd8 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:22.633263 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b214bab9-9f3f-49ff-8bf2-ecb9a081bdd8 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:22.634361 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b214bab9-9f3f-49ff-8bf2-ecb9a081bdd8 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:22.634961 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b214bab9-9f3f-49ff-8bf2-ecb9a081bdd8 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:22.651570 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:22.850083 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b57e75f0-d7c2-4509-a660-b6b1a8f8f929 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:22.860503 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b214bab9-9f3f-49ff-8bf2-ecb9a081bdd8 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:22.867385 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b57e75f0-d7c2-4509-a660-b6b1a8f8f929 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec" status: 200 len: 1319 microversion: 2.1 time: 0.275158 May 23 17:20:22.878649 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 169/348] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:22 2022] GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec => generated 1319 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:22.886007 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b214bab9-9f3f-49ff-8bf2-ecb9a081bdd8 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1358 microversion: 2.1 time: 0.265130 May 23 17:20:22.887182 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 180/349] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:22 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1358 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:22.978149 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e546d315-a090-4eaf-b772-ea7f655020d9 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:22.979048 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e546d315-a090-4eaf-b772-ea7f655020d9 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:22.986817 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e546d315-a090-4eaf-b772-ea7f655020d9 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:22.987446 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e546d315-a090-4eaf-b772-ea7f655020d9 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:22.988384 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e546d315-a090-4eaf-b772-ea7f655020d9 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:22.988864 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e546d315-a090-4eaf-b772-ea7f655020d9 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:23.141201 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e546d315-a090-4eaf-b772-ea7f655020d9 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:23.150666 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e546d315-a090-4eaf-b772-ea7f655020d9 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:23.152486 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e546d315-a090-4eaf-b772-ea7f655020d9 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:23.153808 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e546d315-a090-4eaf-b772-ea7f655020d9 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1740 microversion: 2.20 time: 0.179955 May 23 17:20:23.154538 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 170/350] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:20:22 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:20:23.580165 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-8f1f9ace-f1f4-4753-9835-5820471dff07 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:23.581125 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-8f1f9ace-f1f4-4753-9835-5820471dff07 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:23.587668 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d9ca95d7-b341-4774-a686-70a4c6cfc67c tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:23.588630 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d9ca95d7-b341-4774-a686-70a4c6cfc67c tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: ee74a742-e7c0-4541-8302-b655a0d946ee] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:23.602479 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8f1f9ace-f1f4-4753-9835-5820471dff07 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:23.602966 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8f1f9ace-f1f4-4753-9835-5820471dff07 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:23.603766 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8f1f9ace-f1f4-4753-9835-5820471dff07 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:23.604207 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8f1f9ace-f1f4-4753-9835-5820471dff07 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:23.604756 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d9ca95d7-b341-4774-a686-70a4c6cfc67c tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:23.605770 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d9ca95d7-b341-4774-a686-70a4c6cfc67c tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:23.606601 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d9ca95d7-b341-4774-a686-70a4c6cfc67c tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:23.607112 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d9ca95d7-b341-4774-a686-70a4c6cfc67c tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:24.643770 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d9ca95d7-b341-4774-a686-70a4c6cfc67c tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:24.649761 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-8f1f9ace-f1f4-4753-9835-5820471dff07 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:24.656031 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d9ca95d7-b341-4774-a686-70a4c6cfc67c tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee" status: 200 len: 1503 microversion: 2.1 time: 1.072394 May 23 17:20:24.659965 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-8f1f9ace-f1f4-4753-9835-5820471dff07 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1370 microversion: 2.1 time: 1.083447 May 23 17:20:24.660862 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 181/351] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:23 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1370 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:24.666117 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-6655eaee-4bd1-4531-a063-30426a199f4b tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:24.666980 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-6655eaee-4bd1-4531-a063-30426a199f4b tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 6664de84-4c36-42da-9577-594b6bc73fec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:24.672809 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 171/352] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:23 2022] GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee => generated 1503 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:24.675675 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6655eaee-4bd1-4531-a063-30426a199f4b tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:24.676304 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6655eaee-4bd1-4531-a063-30426a199f4b tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:24.678303 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6655eaee-4bd1-4531-a063-30426a199f4b tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:24.679617 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6655eaee-4bd1-4531-a063-30426a199f4b tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:24.681696 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6a1b5220-d151-4bba-a74a-5a47069d3762 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:24.682520 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6a1b5220-d151-4bba-a74a-5a47069d3762 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:24.713183 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6a1b5220-d151-4bba-a74a-5a47069d3762 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:24.713631 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6a1b5220-d151-4bba-a74a-5a47069d3762 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:24.714507 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6a1b5220-d151-4bba-a74a-5a47069d3762 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:24.714942 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6a1b5220-d151-4bba-a74a-5a47069d3762 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:24.958680 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-6655eaee-4bd1-4531-a063-30426a199f4b tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:24.975611 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-6655eaee-4bd1-4531-a063-30426a199f4b tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec" status: 200 len: 1319 microversion: 2.1 time: 0.313057 May 23 17:20:24.976713 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 182/353] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:24 2022] GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec => generated 1319 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:24.984830 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-9d085c9e-6472-4b09-b02b-f1840ac4c89c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:24.986080 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-9d085c9e-6472-4b09-b02b-f1840ac4c89c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:24.999735 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9d085c9e-6472-4b09-b02b-f1840ac4c89c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:25.001063 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9d085c9e-6472-4b09-b02b-f1840ac4c89c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:25.001931 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9d085c9e-6472-4b09-b02b-f1840ac4c89c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:25.002374 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9d085c9e-6472-4b09-b02b-f1840ac4c89c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:25.042565 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6a1b5220-d151-4bba-a74a-5a47069d3762 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:25.055037 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6a1b5220-d151-4bba-a74a-5a47069d3762 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1358 microversion: 2.1 time: 0.380712 May 23 17:20:25.055635 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 172/354] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:24 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1358 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:25.186265 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9d085c9e-6472-4b09-b02b-f1840ac4c89c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:25.195286 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9d085c9e-6472-4b09-b02b-f1840ac4c89c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:25.196918 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9d085c9e-6472-4b09-b02b-f1840ac4c89c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:25.198171 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-9d085c9e-6472-4b09-b02b-f1840ac4c89c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1740 microversion: 2.20 time: 0.220308 May 23 17:20:25.198819 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 183/355] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:20:24 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1740 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:20:25.673634 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-844df989-dbee-4537-8296-0615a48c3f56 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:25.679416 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-47b16136-d855-4ea1-b849-47489bdd5ec6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:25.680402 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-47b16136-d855-4ea1-b849-47489bdd5ec6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:25.683416 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-844df989-dbee-4537-8296-0615a48c3f56 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: ee74a742-e7c0-4541-8302-b655a0d946ee] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:25.689817 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-47b16136-d855-4ea1-b849-47489bdd5ec6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:25.690080 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-844df989-dbee-4537-8296-0615a48c3f56 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:25.690463 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-47b16136-d855-4ea1-b849-47489bdd5ec6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:25.690922 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-844df989-dbee-4537-8296-0615a48c3f56 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:25.691251 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-47b16136-d855-4ea1-b849-47489bdd5ec6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:25.691689 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-47b16136-d855-4ea1-b849-47489bdd5ec6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:25.691920 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-844df989-dbee-4537-8296-0615a48c3f56 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:25.692421 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-844df989-dbee-4537-8296-0615a48c3f56 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:25.885373 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-844df989-dbee-4537-8296-0615a48c3f56 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:25.892899 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-47b16136-d855-4ea1-b849-47489bdd5ec6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:25.893683 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-844df989-dbee-4537-8296-0615a48c3f56 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee" status: 200 len: 1503 microversion: 2.1 time: 0.224075 May 23 17:20:25.894264 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 173/356] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:25 2022] GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee => generated 1503 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:25.900646 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-47b16136-d855-4ea1-b849-47489bdd5ec6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1370 microversion: 2.1 time: 0.225238 May 23 17:20:25.901204 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 184/357] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:25 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1370 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:25.994971 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9a5882a0-0e7a-4e27-9eab-0fbf43526dc5 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:25.995559 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9a5882a0-0e7a-4e27-9eab-0fbf43526dc5 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 6664de84-4c36-42da-9577-594b6bc73fec] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:26.002232 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9a5882a0-0e7a-4e27-9eab-0fbf43526dc5 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:26.002690 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9a5882a0-0e7a-4e27-9eab-0fbf43526dc5 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:26.003453 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9a5882a0-0e7a-4e27-9eab-0fbf43526dc5 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:26.003879 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9a5882a0-0e7a-4e27-9eab-0fbf43526dc5 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:26.072123 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-930bfe51-4fe1-455b-8889-f8e7b375743b tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:26.072646 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-930bfe51-4fe1-455b-8889-f8e7b375743b tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:26.078889 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-930bfe51-4fe1-455b-8889-f8e7b375743b tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:26.079333 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-930bfe51-4fe1-455b-8889-f8e7b375743b tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:26.080229 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-930bfe51-4fe1-455b-8889-f8e7b375743b tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:26.080508 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-930bfe51-4fe1-455b-8889-f8e7b375743b tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:26.163883 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9a5882a0-0e7a-4e27-9eab-0fbf43526dc5 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:26.171932 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9a5882a0-0e7a-4e27-9eab-0fbf43526dc5 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec" status: 200 len: 1319 microversion: 2.1 time: 0.180951 May 23 17:20:26.172631 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 174/358] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:25 2022] GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:26.216698 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a453e143-b5c8-4014-96b6-f7edfcddb65a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:26.217423 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a453e143-b5c8-4014-96b6-f7edfcddb65a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:26.223733 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a453e143-b5c8-4014-96b6-f7edfcddb65a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:26.224209 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a453e143-b5c8-4014-96b6-f7edfcddb65a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:26.225018 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a453e143-b5c8-4014-96b6-f7edfcddb65a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:26.225452 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a453e143-b5c8-4014-96b6-f7edfcddb65a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:26.226609 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-930bfe51-4fe1-455b-8889-f8e7b375743b tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:26.234241 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-930bfe51-4fe1-455b-8889-f8e7b375743b tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1358 microversion: 2.1 time: 0.166134 May 23 17:20:26.234896 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 185/359] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:26 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:20:26.353932 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a453e143-b5c8-4014-96b6-f7edfcddb65a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:26.362334 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a453e143-b5c8-4014-96b6-f7edfcddb65a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:26.363847 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a453e143-b5c8-4014-96b6-f7edfcddb65a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:26.365040 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a453e143-b5c8-4014-96b6-f7edfcddb65a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1740 microversion: 2.20 time: 0.152385 May 23 17:20:26.365615 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 175/360] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:20:26 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1740 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 17:20:26.915000 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-9f1687dd-5057-4f63-ac9d-c5c3f5bc57ad tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:26.915923 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-9f1687dd-5057-4f63-ac9d-c5c3f5bc57ad tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: ee74a742-e7c0-4541-8302-b655a0d946ee] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:26.924374 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2aea0348-4cc4-4f22-965c-07117fa94f99 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:26.925441 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2aea0348-4cc4-4f22-965c-07117fa94f99 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:26.926975 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9f1687dd-5057-4f63-ac9d-c5c3f5bc57ad tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:26.927715 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9f1687dd-5057-4f63-ac9d-c5c3f5bc57ad tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:26.929699 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9f1687dd-5057-4f63-ac9d-c5c3f5bc57ad tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:26.931663 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9f1687dd-5057-4f63-ac9d-c5c3f5bc57ad tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:26.936191 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2aea0348-4cc4-4f22-965c-07117fa94f99 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:26.936629 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2aea0348-4cc4-4f22-965c-07117fa94f99 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:26.937439 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2aea0348-4cc4-4f22-965c-07117fa94f99 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:26.937849 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2aea0348-4cc4-4f22-965c-07117fa94f99 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:27.132285 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2aea0348-4cc4-4f22-965c-07117fa94f99 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:27.135372 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9f1687dd-5057-4f63-ac9d-c5c3f5bc57ad tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:27.142938 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2aea0348-4cc4-4f22-965c-07117fa94f99 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1370 microversion: 2.1 time: 0.225137 May 23 17:20:27.143407 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-9f1687dd-5057-4f63-ac9d-c5c3f5bc57ad tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee" status: 200 len: 1503 microversion: 2.1 time: 0.234878 May 23 17:20:27.143526 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 176/361] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:26 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1370 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:27.143970 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 186/362] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:26 2022] GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee => generated 1503 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:27.188492 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3f1df40d-8ba9-44b8-81da-8db35d08addb tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:27.189137 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3f1df40d-8ba9-44b8-81da-8db35d08addb tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 6664de84-4c36-42da-9577-594b6bc73fec] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:27.195427 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3f1df40d-8ba9-44b8-81da-8db35d08addb tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:27.195874 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3f1df40d-8ba9-44b8-81da-8db35d08addb tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:27.196638 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3f1df40d-8ba9-44b8-81da-8db35d08addb tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:27.197110 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3f1df40d-8ba9-44b8-81da-8db35d08addb tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:27.251430 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-7c0ab37a-0723-4730-8bad-7e7c6926cf1b tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:27.252062 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-7c0ab37a-0723-4730-8bad-7e7c6926cf1b tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:27.258269 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7c0ab37a-0723-4730-8bad-7e7c6926cf1b tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:27.258716 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7c0ab37a-0723-4730-8bad-7e7c6926cf1b tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:27.259455 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7c0ab37a-0723-4730-8bad-7e7c6926cf1b tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:27.259919 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7c0ab37a-0723-4730-8bad-7e7c6926cf1b tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:27.369639 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3f1df40d-8ba9-44b8-81da-8db35d08addb tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:27.378403 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3f1df40d-8ba9-44b8-81da-8db35d08addb tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec" status: 200 len: 1319 microversion: 2.1 time: 0.193446 May 23 17:20:27.378782 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 177/363] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:27 2022] GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:27.383280 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1ddaf94f-8802-49dc-8c8c-1a4a21cd287d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:27.383861 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1ddaf94f-8802-49dc-8c8c-1a4a21cd287d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:27.390258 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1ddaf94f-8802-49dc-8c8c-1a4a21cd287d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:27.390735 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1ddaf94f-8802-49dc-8c8c-1a4a21cd287d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:27.391496 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1ddaf94f-8802-49dc-8c8c-1a4a21cd287d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:27.391925 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1ddaf94f-8802-49dc-8c8c-1a4a21cd287d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:27.415708 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-7c0ab37a-0723-4730-8bad-7e7c6926cf1b tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:27.424335 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-7c0ab37a-0723-4730-8bad-7e7c6926cf1b tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1358 microversion: 2.1 time: 0.176827 May 23 17:20:27.424969 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 187/364] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:27 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:20:27.523197 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1ddaf94f-8802-49dc-8c8c-1a4a21cd287d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:27.533103 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1ddaf94f-8802-49dc-8c8c-1a4a21cd287d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:27.534643 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1ddaf94f-8802-49dc-8c8c-1a4a21cd287d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:27.535806 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1ddaf94f-8802-49dc-8c8c-1a4a21cd287d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1740 microversion: 2.20 time: 0.156150 May 23 17:20:27.536372 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 178/365] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:20:27 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1740 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:20:28.163040 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d31a613c-8b54-4853-bf62-f63f1841304e tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:28.163738 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d31a613c-8b54-4853-bf62-f63f1841304e tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: ee74a742-e7c0-4541-8302-b655a0d946ee] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:28.166717 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-fb46d9cd-6f11-4388-80f9-0ffed9b604fb tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:28.167329 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-fb46d9cd-6f11-4388-80f9-0ffed9b604fb tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:28.172252 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:28.174423 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fb46d9cd-6f11-4388-80f9-0ffed9b604fb tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:28.174878 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fb46d9cd-6f11-4388-80f9-0ffed9b604fb tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:28.175707 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fb46d9cd-6f11-4388-80f9-0ffed9b604fb tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:28.176329 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fb46d9cd-6f11-4388-80f9-0ffed9b604fb tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:28.177736 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d31a613c-8b54-4853-bf62-f63f1841304e tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:28.178338 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d31a613c-8b54-4853-bf62-f63f1841304e tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:28.179297 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d31a613c-8b54-4853-bf62-f63f1841304e tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:28.179709 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d31a613c-8b54-4853-bf62-f63f1841304e tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:28.504297 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d31a613c-8b54-4853-bf62-f63f1841304e tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:28.513082 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d31a613c-8b54-4853-bf62-f63f1841304e tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee" status: 200 len: 1503 microversion: 2.1 time: 0.356009 May 23 17:20:28.513965 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 179/366] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:28 2022] GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee => generated 1503 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:28.519042 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e055c260-f13c-4d2a-ae8e-2ac1e383a3d0 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:28.519613 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e055c260-f13c-4d2a-ae8e-2ac1e383a3d0 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 6664de84-4c36-42da-9577-594b6bc73fec] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:28.525819 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e055c260-f13c-4d2a-ae8e-2ac1e383a3d0 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:28.526258 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e055c260-f13c-4d2a-ae8e-2ac1e383a3d0 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:28.527151 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e055c260-f13c-4d2a-ae8e-2ac1e383a3d0 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:28.527588 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e055c260-f13c-4d2a-ae8e-2ac1e383a3d0 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:28.562110 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-fb46d9cd-6f11-4388-80f9-0ffed9b604fb tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:28.577013 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-fb46d9cd-6f11-4388-80f9-0ffed9b604fb tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1370 microversion: 2.1 time: 0.421253 May 23 17:20:28.589494 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 188/367] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:28 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1370 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:28.598852 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b58f57b0-73ea-48c4-9e42-0be7a508b370 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:28.599689 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-b58f57b0-73ea-48c4-9e42-0be7a508b370 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:28.608473 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b58f57b0-73ea-48c4-9e42-0be7a508b370 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:28.609376 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b58f57b0-73ea-48c4-9e42-0be7a508b370 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:28.611253 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b58f57b0-73ea-48c4-9e42-0be7a508b370 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:28.611994 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b58f57b0-73ea-48c4-9e42-0be7a508b370 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:28.867542 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e055c260-f13c-4d2a-ae8e-2ac1e383a3d0 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:28.880052 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e055c260-f13c-4d2a-ae8e-2ac1e383a3d0 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec" status: 200 len: 1319 microversion: 2.1 time: 0.363091 May 23 17:20:28.882626 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 180/368] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:28 2022] GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec => generated 1319 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:28.889333 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f17ea1c1-10c7-47fb-aeb2-baaeafca26fd tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:28.890375 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f17ea1c1-10c7-47fb-aeb2-baaeafca26fd tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:28.902364 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f17ea1c1-10c7-47fb-aeb2-baaeafca26fd tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:28.903056 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f17ea1c1-10c7-47fb-aeb2-baaeafca26fd tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:28.904085 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f17ea1c1-10c7-47fb-aeb2-baaeafca26fd tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:28.904778 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f17ea1c1-10c7-47fb-aeb2-baaeafca26fd tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:28.943534 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b58f57b0-73ea-48c4-9e42-0be7a508b370 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:28.956423 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b58f57b0-73ea-48c4-9e42-0be7a508b370 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1358 microversion: 2.1 time: 0.363540 May 23 17:20:28.957140 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 189/369] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:28 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1358 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:28.994219 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-216f8e5b-6ab6-47ab-b4b1-021823b7954a req-15a1c962-b706-4de9-be5c-ff2ed13c7a96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee74a742-e7c0-4541-8302-b655a0d946ee", "name": "network-vif-deleted", "tag": "d9f16a90-40a7-4ac7-b105-adca11f0f1e1"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:20:29.002971 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-216f8e5b-6ab6-47ab-b4b1-021823b7954a req-15a1c962-b706-4de9-be5c-ff2ed13c7a96 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:29.002971 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-216f8e5b-6ab6-47ab-b4b1-021823b7954a req-15a1c962-b706-4de9-be5c-ff2ed13c7a96 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:29.015440 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-216f8e5b-6ab6-47ab-b4b1-021823b7954a req-15a1c962-b706-4de9-be5c-ff2ed13c7a96 service nova] Creating event network-vif-deleted:d9f16a90-40a7-4ac7-b105-adca11f0f1e1 for instance ee74a742-e7c0-4541-8302-b655a0d946ee on hv-cinder-84299 May 23 17:20:29.021418 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-216f8e5b-6ab6-47ab-b4b1-021823b7954a req-15a1c962-b706-4de9-be5c-ff2ed13c7a96 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030857 May 23 17:20:29.022123 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 190/370] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 17:20:29.135734 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-a72df50e-3fd8-46ef-af8a-aa760889669f req-32092b5a-8361-461f-8df3-36a32e12ad1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c26b20b6-8a97-4aa1-af83-616cc09c9165", "tag": "b66d0e22-835b-4627-b12b-de1e251bd6e9"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:20:29.145217 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-a72df50e-3fd8-46ef-af8a-aa760889669f req-32092b5a-8361-461f-8df3-36a32e12ad1c service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:29.145620 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-a72df50e-3fd8-46ef-af8a-aa760889669f req-32092b5a-8361-461f-8df3-36a32e12ad1c service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:29.157498 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-a72df50e-3fd8-46ef-af8a-aa760889669f req-32092b5a-8361-461f-8df3-36a32e12ad1c service nova] Creating event network-changed:b66d0e22-835b-4627-b12b-de1e251bd6e9 for instance c26b20b6-8a97-4aa1-af83-616cc09c9165 on hv-cinder-84299 May 23 17:20:29.160728 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f17ea1c1-10c7-47fb-aeb2-baaeafca26fd tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:29.162603 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-a72df50e-3fd8-46ef-af8a-aa760889669f req-32092b5a-8361-461f-8df3-36a32e12ad1c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030928 May 23 17:20:29.163258 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 191/371] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:20:29.172111 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f17ea1c1-10c7-47fb-aeb2-baaeafca26fd tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:29.173890 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f17ea1c1-10c7-47fb-aeb2-baaeafca26fd tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:29.175193 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f17ea1c1-10c7-47fb-aeb2-baaeafca26fd tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1740 microversion: 2.20 time: 0.291421 May 23 17:20:29.175830 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 181/372] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:20:28 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1740 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:20:29.531696 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-433de66d-208d-4990-9741-d3b79a27b9e0 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:29.532386 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-433de66d-208d-4990-9741-d3b79a27b9e0 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: ee74a742-e7c0-4541-8302-b655a0d946ee] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:29.539172 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-433de66d-208d-4990-9741-d3b79a27b9e0 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:29.539779 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-433de66d-208d-4990-9741-d3b79a27b9e0 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:29.540542 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-433de66d-208d-4990-9741-d3b79a27b9e0 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:29.541061 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-433de66d-208d-4990-9741-d3b79a27b9e0 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:29.596843 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5beaa2e6-072c-440e-b690-39d1734e457b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:29.597556 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5beaa2e6-072c-440e-b690-39d1734e457b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:29.603698 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-433de66d-208d-4990-9741-d3b79a27b9e0 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:29.603859 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5beaa2e6-072c-440e-b690-39d1734e457b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:29.604148 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5beaa2e6-072c-440e-b690-39d1734e457b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:29.604954 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5beaa2e6-072c-440e-b690-39d1734e457b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:29.605390 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5beaa2e6-072c-440e-b690-39d1734e457b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:29.611688 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-433de66d-208d-4990-9741-d3b79a27b9e0 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee" status: 200 len: 1461 microversion: 2.1 time: 0.084774 May 23 17:20:29.616781 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 192/373] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:29 2022] GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee => generated 1461 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:29.746187 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5beaa2e6-072c-440e-b690-39d1734e457b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:29.754014 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5beaa2e6-072c-440e-b690-39d1734e457b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1370 microversion: 2.1 time: 0.161114 May 23 17:20:29.754606 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 182/374] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:29 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:20:29.903173 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-476a4dc0-f8b4-4a7a-87d4-506245846825 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:29.904233 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-476a4dc0-f8b4-4a7a-87d4-506245846825 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 6664de84-4c36-42da-9577-594b6bc73fec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:29.911798 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-476a4dc0-f8b4-4a7a-87d4-506245846825 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:29.912336 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-476a4dc0-f8b4-4a7a-87d4-506245846825 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:29.913229 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-476a4dc0-f8b4-4a7a-87d4-506245846825 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:29.913711 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-476a4dc0-f8b4-4a7a-87d4-506245846825 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:29.973542 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-161854b0-e000-49b5-a214-98037bcc4bba tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:29.974263 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-161854b0-e000-49b5-a214-98037bcc4bba tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:29.980751 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-161854b0-e000-49b5-a214-98037bcc4bba tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:29.981200 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-161854b0-e000-49b5-a214-98037bcc4bba tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:29.981964 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-161854b0-e000-49b5-a214-98037bcc4bba tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:29.982422 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-161854b0-e000-49b5-a214-98037bcc4bba tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:30.083379 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-476a4dc0-f8b4-4a7a-87d4-506245846825 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:30.091774 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-476a4dc0-f8b4-4a7a-87d4-506245846825 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec" status: 200 len: 1319 microversion: 2.1 time: 0.195189 May 23 17:20:30.092413 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 193/375] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:29 2022] GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:30.131547 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-161854b0-e000-49b5-a214-98037bcc4bba tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:30.140065 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-161854b0-e000-49b5-a214-98037bcc4bba tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1358 microversion: 2.1 time: 0.170476 May 23 17:20:30.140640 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 183/376] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:29 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:30.194427 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-bad0e7b3-7a93-4d0c-a7c4-0c5073b388ad tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:30.195028 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-bad0e7b3-7a93-4d0c-a7c4-0c5073b388ad tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:30.201234 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bad0e7b3-7a93-4d0c-a7c4-0c5073b388ad tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:30.201676 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bad0e7b3-7a93-4d0c-a7c4-0c5073b388ad tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:30.202437 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bad0e7b3-7a93-4d0c-a7c4-0c5073b388ad tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:30.202865 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bad0e7b3-7a93-4d0c-a7c4-0c5073b388ad tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:30.339526 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-bad0e7b3-7a93-4d0c-a7c4-0c5073b388ad tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:30.348057 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-bad0e7b3-7a93-4d0c-a7c4-0c5073b388ad tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:30.349581 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-bad0e7b3-7a93-4d0c-a7c4-0c5073b388ad tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:30.350753 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-bad0e7b3-7a93-4d0c-a7c4-0c5073b388ad tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1740 microversion: 2.20 time: 0.160232 May 23 17:20:30.351345 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 194/377] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:20:30 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1740 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:20:30.629453 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-140b9d23-d307-4fa6-b65e-f5eb8dfef498 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:30.630067 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-140b9d23-d307-4fa6-b65e-f5eb8dfef498 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: ee74a742-e7c0-4541-8302-b655a0d946ee] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:30.636345 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-140b9d23-d307-4fa6-b65e-f5eb8dfef498 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:30.636827 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-140b9d23-d307-4fa6-b65e-f5eb8dfef498 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:30.637591 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-140b9d23-d307-4fa6-b65e-f5eb8dfef498 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:30.638397 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-140b9d23-d307-4fa6-b65e-f5eb8dfef498 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:30.698096 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-140b9d23-d307-4fa6-b65e-f5eb8dfef498 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:30.705798 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-140b9d23-d307-4fa6-b65e-f5eb8dfef498 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee" status: 200 len: 1461 microversion: 2.1 time: 0.080234 May 23 17:20:30.706364 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 184/378] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:30 2022] GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee => generated 1461 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:30.774896 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e55890e1-f5cc-4c1b-9ddb-b44e940f15da tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:30.776046 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-e55890e1-f5cc-4c1b-9ddb-b44e940f15da tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:30.786887 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e55890e1-f5cc-4c1b-9ddb-b44e940f15da tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:30.787788 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e55890e1-f5cc-4c1b-9ddb-b44e940f15da tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:30.789219 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e55890e1-f5cc-4c1b-9ddb-b44e940f15da tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:30.790058 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e55890e1-f5cc-4c1b-9ddb-b44e940f15da tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:30.921020 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e55890e1-f5cc-4c1b-9ddb-b44e940f15da tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:30.928712 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-e55890e1-f5cc-4c1b-9ddb-b44e940f15da tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1370 microversion: 2.1 time: 0.160358 May 23 17:20:30.929406 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 195/379] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:30 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:31.111071 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4f5560c5-d722-4b40-97a9-36056daecf9d tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:31.111857 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4f5560c5-d722-4b40-97a9-36056daecf9d tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 6664de84-4c36-42da-9577-594b6bc73fec] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:31.119458 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4f5560c5-d722-4b40-97a9-36056daecf9d tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:31.119983 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4f5560c5-d722-4b40-97a9-36056daecf9d tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:31.120893 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4f5560c5-d722-4b40-97a9-36056daecf9d tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:31.121450 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4f5560c5-d722-4b40-97a9-36056daecf9d tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:31.157705 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-12439b28-3b45-4d6d-bd6c-136dbbc68871 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:31.158318 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-12439b28-3b45-4d6d-bd6c-136dbbc68871 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:31.164893 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-12439b28-3b45-4d6d-bd6c-136dbbc68871 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:31.165348 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-12439b28-3b45-4d6d-bd6c-136dbbc68871 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:31.166104 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-12439b28-3b45-4d6d-bd6c-136dbbc68871 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:31.166533 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-12439b28-3b45-4d6d-bd6c-136dbbc68871 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:31.294598 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4f5560c5-d722-4b40-97a9-36056daecf9d tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:31.296820 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:31.303608 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4f5560c5-d722-4b40-97a9-36056daecf9d tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec" status: 200 len: 1319 microversion: 2.1 time: 0.197638 May 23 17:20:31.304423 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 185/380] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:31 2022] GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:31.327584 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-12439b28-3b45-4d6d-bd6c-136dbbc68871 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:31.335722 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-12439b28-3b45-4d6d-bd6c-136dbbc68871 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1358 microversion: 2.1 time: 0.182322 May 23 17:20:31.336295 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 196/381] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:31 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:31.369886 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8eabba30-5370-44eb-9b44-16e2ef8743d1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:31.370498 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8eabba30-5370-44eb-9b44-16e2ef8743d1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:31.377005 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8eabba30-5370-44eb-9b44-16e2ef8743d1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:31.377398 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8eabba30-5370-44eb-9b44-16e2ef8743d1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:31.378170 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8eabba30-5370-44eb-9b44-16e2ef8743d1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:31.378614 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8eabba30-5370-44eb-9b44-16e2ef8743d1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:31.514516 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8eabba30-5370-44eb-9b44-16e2ef8743d1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:31.522904 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8eabba30-5370-44eb-9b44-16e2ef8743d1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:31.524437 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8eabba30-5370-44eb-9b44-16e2ef8743d1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:31.525637 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8eabba30-5370-44eb-9b44-16e2ef8743d1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1740 microversion: 2.20 time: 0.160037 May 23 17:20:31.526414 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 186/382] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:20:31 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1740 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:20:31.723415 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-dfeff11d-9ff2-43fe-a84f-5ab20efcbb21 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:31.724176 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-dfeff11d-9ff2-43fe-a84f-5ab20efcbb21 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: ee74a742-e7c0-4541-8302-b655a0d946ee] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:31.730439 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-dfeff11d-9ff2-43fe-a84f-5ab20efcbb21 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:31.730993 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-dfeff11d-9ff2-43fe-a84f-5ab20efcbb21 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:31.731776 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-dfeff11d-9ff2-43fe-a84f-5ab20efcbb21 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:31.732235 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-dfeff11d-9ff2-43fe-a84f-5ab20efcbb21 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:31.792266 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-dfeff11d-9ff2-43fe-a84f-5ab20efcbb21 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:31.800181 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-dfeff11d-9ff2-43fe-a84f-5ab20efcbb21 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee" status: 200 len: 1461 microversion: 2.1 time: 0.080700 May 23 17:20:31.800917 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 197/383] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:31 2022] GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee => generated 1461 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:31.950052 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4f8684ae-a88c-43a3-bd0b-5eba6ca1f10e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:31.950931 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4f8684ae-a88c-43a3-bd0b-5eba6ca1f10e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:31.961233 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4f8684ae-a88c-43a3-bd0b-5eba6ca1f10e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:31.961970 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4f8684ae-a88c-43a3-bd0b-5eba6ca1f10e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:31.963237 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4f8684ae-a88c-43a3-bd0b-5eba6ca1f10e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:31.963955 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4f8684ae-a88c-43a3-bd0b-5eba6ca1f10e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:32.101880 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4f8684ae-a88c-43a3-bd0b-5eba6ca1f10e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:32.113479 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4f8684ae-a88c-43a3-bd0b-5eba6ca1f10e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1370 microversion: 2.1 time: 0.170007 May 23 17:20:32.114391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 187/384] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:31 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:32.287194 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-cc985bf8-35b5-4946-9701-219cf4534ead req-1fbbbf64-e7b1-463a-ba65-020c45b11ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4273c3a-0aba-4184-b088-2feaea1b1091", "name": "network-vif-unplugged", "status": "completed", "tag": "0c234a65-eea7-4bdf-ac00-34147e4abec0"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:20:32.298643 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-cc985bf8-35b5-4946-9701-219cf4534ead req-1fbbbf64-e7b1-463a-ba65-020c45b11ee2 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:32.299333 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-cc985bf8-35b5-4946-9701-219cf4534ead req-1fbbbf64-e7b1-463a-ba65-020c45b11ee2 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:32.313021 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-cc985bf8-35b5-4946-9701-219cf4534ead req-1fbbbf64-e7b1-463a-ba65-020c45b11ee2 service nova] Creating event network-vif-unplugged:0c234a65-eea7-4bdf-ac00-34147e4abec0 for instance f4273c3a-0aba-4184-b088-2feaea1b1091 on hv-cinder-84299 May 23 17:20:32.318573 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-cc985bf8-35b5-4946-9701-219cf4534ead req-1fbbbf64-e7b1-463a-ba65-020c45b11ee2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037493 May 23 17:20:32.319186 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 198/385] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 17:20:32.323605 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e14da2da-786e-4038-9c0f-55d5afef6f10 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:32.324105 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e14da2da-786e-4038-9c0f-55d5afef6f10 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 6664de84-4c36-42da-9577-594b6bc73fec] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:32.330927 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e14da2da-786e-4038-9c0f-55d5afef6f10 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:32.331370 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e14da2da-786e-4038-9c0f-55d5afef6f10 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:32.332172 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e14da2da-786e-4038-9c0f-55d5afef6f10 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:32.332594 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e14da2da-786e-4038-9c0f-55d5afef6f10 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:32.355705 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-6faed52c-5d9b-47a0-893f-678ca2edf1dd tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:32.356577 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-6faed52c-5d9b-47a0-893f-678ca2edf1dd tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:32.364027 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6faed52c-5d9b-47a0-893f-678ca2edf1dd tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:32.364526 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6faed52c-5d9b-47a0-893f-678ca2edf1dd tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:32.365567 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6faed52c-5d9b-47a0-893f-678ca2edf1dd tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:32.366032 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6faed52c-5d9b-47a0-893f-678ca2edf1dd tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:32.372212 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=100 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:32.519794 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e14da2da-786e-4038-9c0f-55d5afef6f10 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:32.528015 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e14da2da-786e-4038-9c0f-55d5afef6f10 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec" status: 200 len: 1319 microversion: 2.1 time: 0.209694 May 23 17:20:32.528930 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 188/386] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:32 2022] GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:32.543912 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-402bf8c7-653f-449d-9126-e7ac226dc791 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:32.544756 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-402bf8c7-653f-449d-9126-e7ac226dc791 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:32.546152 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-6faed52c-5d9b-47a0-893f-678ca2edf1dd tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:32.551455 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-402bf8c7-653f-449d-9126-e7ac226dc791 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:32.551913 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-402bf8c7-653f-449d-9126-e7ac226dc791 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:32.552793 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-402bf8c7-653f-449d-9126-e7ac226dc791 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:32.553252 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-402bf8c7-653f-449d-9126-e7ac226dc791 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:32.554798 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-6faed52c-5d9b-47a0-893f-678ca2edf1dd tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1358 microversion: 2.1 time: 0.204572 May 23 17:20:32.555588 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 199/387] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:32 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:20:32.690696 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-402bf8c7-653f-449d-9126-e7ac226dc791 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:32.700207 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-402bf8c7-653f-449d-9126-e7ac226dc791 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:32.702906 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-402bf8c7-653f-449d-9126-e7ac226dc791 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:32.703073 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-402bf8c7-653f-449d-9126-e7ac226dc791 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1722 microversion: 2.20 time: 0.163376 May 23 17:20:32.711169 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 189/388] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:20:32 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:20:32.817943 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-45293a2e-0d0e-4f1a-8ee5-4aeedaedc4a1 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:32.818641 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-45293a2e-0d0e-4f1a-8ee5-4aeedaedc4a1 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: ee74a742-e7c0-4541-8302-b655a0d946ee] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:32.825771 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-45293a2e-0d0e-4f1a-8ee5-4aeedaedc4a1 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:32.826617 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-45293a2e-0d0e-4f1a-8ee5-4aeedaedc4a1 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:32.827663 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-45293a2e-0d0e-4f1a-8ee5-4aeedaedc4a1 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:32.828281 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-45293a2e-0d0e-4f1a-8ee5-4aeedaedc4a1 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:32.904960 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-45293a2e-0d0e-4f1a-8ee5-4aeedaedc4a1 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b88d284f57a44ddcb0f1347942a2950b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c15be59539430b9f25b8236c4d03c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:32.913734 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-45293a2e-0d0e-4f1a-8ee5-4aeedaedc4a1 tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee" status: 200 len: 1299 microversion: 2.1 time: 0.099546 May 23 17:20:32.914319 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 200/389] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:32 2022] GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee => generated 1299 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:33.134441 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7d1a0c5a-5472-4947-92df-3ed09401ab04 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:33.135144 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7d1a0c5a-5472-4947-92df-3ed09401ab04 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:33.142275 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7d1a0c5a-5472-4947-92df-3ed09401ab04 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:33.142714 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7d1a0c5a-5472-4947-92df-3ed09401ab04 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:33.143746 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7d1a0c5a-5472-4947-92df-3ed09401ab04 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:33.144182 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7d1a0c5a-5472-4947-92df-3ed09401ab04 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:33.305307 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7d1a0c5a-5472-4947-92df-3ed09401ab04 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:33.316965 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7d1a0c5a-5472-4947-92df-3ed09401ab04 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1370 microversion: 2.1 time: 0.186234 May 23 17:20:33.317790 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 190/390] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:33 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1370 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:33.545755 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-710baa79-94fe-41f8-9dc6-d1aaa25569ab tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:33.546734 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-710baa79-94fe-41f8-9dc6-d1aaa25569ab tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 6664de84-4c36-42da-9577-594b6bc73fec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:33.553366 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-710baa79-94fe-41f8-9dc6-d1aaa25569ab tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:33.553802 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-710baa79-94fe-41f8-9dc6-d1aaa25569ab tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:33.554572 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-710baa79-94fe-41f8-9dc6-d1aaa25569ab tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:33.555004 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-710baa79-94fe-41f8-9dc6-d1aaa25569ab tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:33.571246 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-dcf476b1-85f0-416e-ada2-5f00261074e9 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:33.571861 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-dcf476b1-85f0-416e-ada2-5f00261074e9 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:33.580856 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dcf476b1-85f0-416e-ada2-5f00261074e9 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:33.584740 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dcf476b1-85f0-416e-ada2-5f00261074e9 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:33.585413 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dcf476b1-85f0-416e-ada2-5f00261074e9 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:33.585870 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dcf476b1-85f0-416e-ada2-5f00261074e9 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:33.872806 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-710baa79-94fe-41f8-9dc6-d1aaa25569ab tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:33.880746 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-710baa79-94fe-41f8-9dc6-d1aaa25569ab tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec" status: 200 len: 1508 microversion: 2.1 time: 0.338882 May 23 17:20:33.881393 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 201/391] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:33 2022] GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec => generated 1508 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:33.886154 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a55d801d-c2f5-4a3d-9ce4-60966bbd1341 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:33.886986 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-a55d801d-c2f5-4a3d-9ce4-60966bbd1341 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:33.893640 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a55d801d-c2f5-4a3d-9ce4-60966bbd1341 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:33.894422 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a55d801d-c2f5-4a3d-9ce4-60966bbd1341 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:33.897045 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a55d801d-c2f5-4a3d-9ce4-60966bbd1341 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:33.897504 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a55d801d-c2f5-4a3d-9ce4-60966bbd1341 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:33.969308 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-dcf476b1-85f0-416e-ada2-5f00261074e9 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:33.982035 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-dcf476b1-85f0-416e-ada2-5f00261074e9 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1358 microversion: 2.1 time: 0.414429 May 23 17:20:33.985243 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 191/392] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:33 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1358 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:20:33.999665 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-528a2f30-7f8b-4a0a-9a6f-98ada895134e tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:34.003849 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-528a2f30-7f8b-4a0a-9a6f-98ada895134e tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] [instance: ee74a742-e7c0-4541-8302-b655a0d946ee] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:34.017967 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-528a2f30-7f8b-4a0a-9a6f-98ada895134e tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:34.019238 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-528a2f30-7f8b-4a0a-9a6f-98ada895134e tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:34.020245 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-528a2f30-7f8b-4a0a-9a6f-98ada895134e tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:34.021579 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-528a2f30-7f8b-4a0a-9a6f-98ada895134e tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:34.060892 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-528a2f30-7f8b-4a0a-9a6f-98ada895134e tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] HTTP exception thrown: Instance ee74a742-e7c0-4541-8302-b655a0d946ee could not be found. May 23 17:20:34.072854 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-528a2f30-7f8b-4a0a-9a6f-98ada895134e tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Request method failure captured: May 23 17:20:34.072854 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: request: GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee HTTP/1.1 May 23 17:20:34.072854 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept: application/json May 23 17:20:34.072854 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity May 23 17:20:34.072854 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Connection: close May 23 17:20:34.072854 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Length: 0 May 23 17:20:34.072854 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Type: application/json May 23 17:20:34.072854 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Host: 10.222.0.46 May 23 17:20:34.072854 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None May 23 17:20:34.072854 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.9 May 23 17:20:34.072854 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABii8IZIj4ejcgBk8UEeEUYtmxvYyBBzlXVyMoYRmpwPkoekSPqjwM15OCZ4NJDyxaD_WUbfKJpP9BIkQJyj0joJj_JCgvWhMPLT8rjzDweJ8eDk_atHZ0d92PFlbjjyoudi6DhjnYxSsNBvKYOXBPcBnesBC2xmvH1u7H1VzOwiPCC4ZI May 23 17:20:34.072854 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Id: None May 23 17:20:34.072854 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Name: None May 23 17:20:34.072854 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed May 23 17:20:34.072854 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True May 23 17:20:34.072854 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default May 23 17:20:34.072854 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default May 23 17:20:34.072854 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Id: 31c15be59539430b9f25b8236c4d03c7 May 23 17:20:34.072854 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-VolumesActionsTest-2079560654 May 23 17:20:34.072854 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Role: reader,member May 23 17:20:34.072854 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Roles: reader,member May 23 17:20:34.074483 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31c15be59539430b9f25b8236c4d03c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/31c15be59539430b9f25b8236c4d03c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31c15be59539430b9f25b8236c4d03c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_31c15be59539430b9f25b8236c4d03c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:20:34.074483 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-VolumesActionsTest-2079560654 May 23 17:20:34.074483 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 31c15be59539430b9f25b8236c4d03c7 May 23 17:20:34.074483 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-VolumesActionsTest-2079560654 May 23 17:20:34.074483 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User: tempest-VolumesActionsTest-2079560654-project May 23 17:20:34.074483 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default May 23 17:20:34.074483 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default May 23 17:20:34.074483 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Id: b88d284f57a44ddcb0f1347942a2950b May 23 17:20:34.074483 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-VolumesActionsTest-2079560654-project May 23 17:20:34.074483 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: method: > May 23 17:20:34.074483 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: exception: Instance ee74a742-e7c0-4541-8302-b655a0d946ee could not be found. May 23 17:20:34.074483 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: action_args: {'id': 'ee74a742-e7c0-4541-8302-b655a0d946ee'} May 23 17:20:34.075306 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:20:34.075306 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:20:34.075306 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:20:34.075306 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:20:34.075306 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:20:34.075306 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:20:34.075306 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:20:34.075306 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:20:34.075306 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:20:34.075306 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:20:34.075306 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee74a742-e7c0-4541-8302-b655a0d946ee could not be found. May 23 17:20:34.075306 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:20:34.075306 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:20:34.075306 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:20:34.075306 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:20:34.075306 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:20:34.075306 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:20:34.075306 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:20:34.075306 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:20:34.075306 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:20:34.076657 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:20:34.076657 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 17:20:34.076657 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 17:20:34.076657 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:20:34.076657 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:20:34.076657 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:20:34.076657 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:20:34.076657 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee74a742-e7c0-4541-8302-b655a0d946ee could not be found. May 23 17:20:34.076657 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:20:34.076657 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:20:34.076657 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:20:34.076657 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:20:34.076657 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:20:34.076657 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:20:34.076657 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:20:34.076657 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:20:34.076657 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee74a742-e7c0-4541-8302-b655a0d946ee could not be found. May 23 17:20:34.076657 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:20:34.079241 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-528a2f30-7f8b-4a0a-9a6f-98ada895134e tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] Returning 404 to user: Instance ee74a742-e7c0-4541-8302-b655a0d946ee could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:20:34.080274 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-528a2f30-7f8b-4a0a-9a6f-98ada895134e tempest-VolumesActionsTest-2079560654 tempest-VolumesActionsTest-2079560654-project] 10.222.0.46 "GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee" status: 404 len: 111 microversion: 2.1 time: 0.093832 May 23 17:20:34.081318 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 192/393] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:33 2022] GET /compute/v2.1/servers/ee74a742-e7c0-4541-8302-b655a0d946ee => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:20:34.136039 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a55d801d-c2f5-4a3d-9ce4-60966bbd1341 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:34.144768 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a55d801d-c2f5-4a3d-9ce4-60966bbd1341 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:34.146253 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a55d801d-c2f5-4a3d-9ce4-60966bbd1341 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:34.147632 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-a55d801d-c2f5-4a3d-9ce4-60966bbd1341 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1722 microversion: 2.20 time: 0.265044 May 23 17:20:34.148939 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 202/394] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:20:33 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1722 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:20:34.333794 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6ab23d34-14c3-4815-a8f5-bb5406f0d470 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:34.335947 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6ab23d34-14c3-4815-a8f5-bb5406f0d470 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:34.342337 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6ab23d34-14c3-4815-a8f5-bb5406f0d470 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:34.343027 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6ab23d34-14c3-4815-a8f5-bb5406f0d470 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:34.344233 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6ab23d34-14c3-4815-a8f5-bb5406f0d470 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:34.344697 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6ab23d34-14c3-4815-a8f5-bb5406f0d470 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:34.550320 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6ab23d34-14c3-4815-a8f5-bb5406f0d470 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:34.558587 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6ab23d34-14c3-4815-a8f5-bb5406f0d470 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1370 microversion: 2.1 time: 0.228579 May 23 17:20:34.559179 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 193/395] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:34 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1370 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:35.003144 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-0730cf84-75b5-4b9d-ae1c-543755661427 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:35.003945 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-0730cf84-75b5-4b9d-ae1c-543755661427 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:35.011487 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0730cf84-75b5-4b9d-ae1c-543755661427 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:35.011935 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0730cf84-75b5-4b9d-ae1c-543755661427 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:35.013138 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0730cf84-75b5-4b9d-ae1c-543755661427 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:35.013568 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0730cf84-75b5-4b9d-ae1c-543755661427 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:35.168397 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d78e5b7a-1418-418b-a99b-ec39eb47b82b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:35.169678 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d78e5b7a-1418-418b-a99b-ec39eb47b82b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:35.172326 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-0730cf84-75b5-4b9d-ae1c-543755661427 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:35.176640 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d78e5b7a-1418-418b-a99b-ec39eb47b82b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:35.177512 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d78e5b7a-1418-418b-a99b-ec39eb47b82b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:35.178289 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d78e5b7a-1418-418b-a99b-ec39eb47b82b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:35.178720 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d78e5b7a-1418-418b-a99b-ec39eb47b82b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:35.181916 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-0730cf84-75b5-4b9d-ae1c-543755661427 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1358 microversion: 2.1 time: 0.183051 May 23 17:20:35.182579 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 203/396] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:34 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:35.325747 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d78e5b7a-1418-418b-a99b-ec39eb47b82b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:35.333778 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d78e5b7a-1418-418b-a99b-ec39eb47b82b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:35.335295 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d78e5b7a-1418-418b-a99b-ec39eb47b82b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:35.336571 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d78e5b7a-1418-418b-a99b-ec39eb47b82b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1722 microversion: 2.20 time: 0.172677 May 23 17:20:35.337210 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 194/397] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:20:35 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:20:35.575864 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-8d6eae0f-9ae9-4aa3-9b9c-8f4dbd0cac79 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:35.576468 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-8d6eae0f-9ae9-4aa3-9b9c-8f4dbd0cac79 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:35.582787 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8d6eae0f-9ae9-4aa3-9b9c-8f4dbd0cac79 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:35.583228 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8d6eae0f-9ae9-4aa3-9b9c-8f4dbd0cac79 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:35.583983 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8d6eae0f-9ae9-4aa3-9b9c-8f4dbd0cac79 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:35.584411 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8d6eae0f-9ae9-4aa3-9b9c-8f4dbd0cac79 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:35.722696 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-8d6eae0f-9ae9-4aa3-9b9c-8f4dbd0cac79 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:35.730726 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-8d6eae0f-9ae9-4aa3-9b9c-8f4dbd0cac79 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1370 microversion: 2.1 time: 0.158923 May 23 17:20:35.731306 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 204/398] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:35 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:36.199784 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-331d18aa-ea21-4e7e-bd47-8dc747bf376e tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:36.200313 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-331d18aa-ea21-4e7e-bd47-8dc747bf376e tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:36.207530 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-331d18aa-ea21-4e7e-bd47-8dc747bf376e tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:36.207986 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-331d18aa-ea21-4e7e-bd47-8dc747bf376e tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:36.208824 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-331d18aa-ea21-4e7e-bd47-8dc747bf376e tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:36.209287 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-331d18aa-ea21-4e7e-bd47-8dc747bf376e tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:36.343061 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-331d18aa-ea21-4e7e-bd47-8dc747bf376e tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:36.351431 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-331d18aa-ea21-4e7e-bd47-8dc747bf376e tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1358 microversion: 2.1 time: 0.155605 May 23 17:20:36.352730 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 195/399] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:36 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:36.358230 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-ff66ac37-a28b-4df6-b321-0a9e14210c12 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:36.358911 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-ff66ac37-a28b-4df6-b321-0a9e14210c12 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:36.365902 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ff66ac37-a28b-4df6-b321-0a9e14210c12 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:36.366352 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ff66ac37-a28b-4df6-b321-0a9e14210c12 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:36.367121 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ff66ac37-a28b-4df6-b321-0a9e14210c12 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:36.367557 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ff66ac37-a28b-4df6-b321-0a9e14210c12 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:36.502048 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ff66ac37-a28b-4df6-b321-0a9e14210c12 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:36.511173 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ff66ac37-a28b-4df6-b321-0a9e14210c12 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:36.513071 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ff66ac37-a28b-4df6-b321-0a9e14210c12 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:36.514330 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-ff66ac37-a28b-4df6-b321-0a9e14210c12 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1722 microversion: 2.20 time: 0.160158 May 23 17:20:36.514903 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 205/400] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:20:36 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:20:36.751469 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-da36c0ce-d854-4843-a1c9-8aee3869b453 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:36.752455 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-da36c0ce-d854-4843-a1c9-8aee3869b453 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:36.763140 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-da36c0ce-d854-4843-a1c9-8aee3869b453 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:36.763881 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-da36c0ce-d854-4843-a1c9-8aee3869b453 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:36.764906 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-da36c0ce-d854-4843-a1c9-8aee3869b453 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:36.765363 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-da36c0ce-d854-4843-a1c9-8aee3869b453 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:36.901601 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-da36c0ce-d854-4843-a1c9-8aee3869b453 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:36.909595 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-da36c0ce-d854-4843-a1c9-8aee3869b453 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1370 microversion: 2.1 time: 0.164929 May 23 17:20:36.910145 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 196/401] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:36 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:37.369600 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d87d1ba4-320b-4a0c-9488-bb9dfd66e342 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:37.370242 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d87d1ba4-320b-4a0c-9488-bb9dfd66e342 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:37.377555 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d87d1ba4-320b-4a0c-9488-bb9dfd66e342 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:37.378004 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d87d1ba4-320b-4a0c-9488-bb9dfd66e342 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:37.378782 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d87d1ba4-320b-4a0c-9488-bb9dfd66e342 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:37.379217 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d87d1ba4-320b-4a0c-9488-bb9dfd66e342 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:37.521867 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d87d1ba4-320b-4a0c-9488-bb9dfd66e342 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:37.530044 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d87d1ba4-320b-4a0c-9488-bb9dfd66e342 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1358 microversion: 2.1 time: 0.164333 May 23 17:20:37.530636 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 206/402] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:37 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:37.532814 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-cd047dd4-34eb-4550-ab8a-9c24a30618b8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:37.533431 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-cd047dd4-34eb-4550-ab8a-9c24a30618b8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:37.540312 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cd047dd4-34eb-4550-ab8a-9c24a30618b8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:37.540795 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cd047dd4-34eb-4550-ab8a-9c24a30618b8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:37.541577 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cd047dd4-34eb-4550-ab8a-9c24a30618b8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:37.542003 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cd047dd4-34eb-4550-ab8a-9c24a30618b8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:37.692142 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-cd047dd4-34eb-4550-ab8a-9c24a30618b8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:37.700270 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-cd047dd4-34eb-4550-ab8a-9c24a30618b8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:37.701920 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-cd047dd4-34eb-4550-ab8a-9c24a30618b8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:37.703110 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-cd047dd4-34eb-4550-ab8a-9c24a30618b8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1722 microversion: 2.20 time: 0.174448 May 23 17:20:37.703845 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 197/403] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:20:37 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 17:20:37.931466 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-4e18ed18-a6e5-414c-b029-ca35ee5a6344 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:37.932488 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-4e18ed18-a6e5-414c-b029-ca35ee5a6344 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:37.940961 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4e18ed18-a6e5-414c-b029-ca35ee5a6344 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:37.941420 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4e18ed18-a6e5-414c-b029-ca35ee5a6344 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:37.942199 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4e18ed18-a6e5-414c-b029-ca35ee5a6344 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:37.942631 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4e18ed18-a6e5-414c-b029-ca35ee5a6344 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:38.154911 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-4e18ed18-a6e5-414c-b029-ca35ee5a6344 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:38.163670 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-4e18ed18-a6e5-414c-b029-ca35ee5a6344 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1370 microversion: 2.1 time: 0.240173 May 23 17:20:38.164235 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 207/404] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:37 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1370 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:38.549771 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b202c277-cf9f-4256-b2f5-0a365d79ef2c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:38.550386 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b202c277-cf9f-4256-b2f5-0a365d79ef2c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:38.557637 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b202c277-cf9f-4256-b2f5-0a365d79ef2c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:38.558213 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b202c277-cf9f-4256-b2f5-0a365d79ef2c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:38.559065 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b202c277-cf9f-4256-b2f5-0a365d79ef2c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:38.559500 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b202c277-cf9f-4256-b2f5-0a365d79ef2c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:38.619022 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-c0deb83d-d539-45ab-8854-3cfd0ad2976d req-78cbd1d7-2eef-45c1-8bd3-187ebf61349d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c6c849e-492f-4bd4-91d8-f1622420a3d2", "name": "network-vif-plugged", "status": "completed", "tag": "b64de995-4ddd-4471-a42a-480203d490ce"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:20:38.629922 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-c0deb83d-d539-45ab-8854-3cfd0ad2976d req-78cbd1d7-2eef-45c1-8bd3-187ebf61349d service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:38.630726 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-c0deb83d-d539-45ab-8854-3cfd0ad2976d req-78cbd1d7-2eef-45c1-8bd3-187ebf61349d service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:38.646564 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-c0deb83d-d539-45ab-8854-3cfd0ad2976d req-78cbd1d7-2eef-45c1-8bd3-187ebf61349d service nova] Creating event network-vif-plugged:b64de995-4ddd-4471-a42a-480203d490ce for instance 7c6c849e-492f-4bd4-91d8-f1622420a3d2 on hv-cinder-84299 May 23 17:20:38.654879 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-c0deb83d-d539-45ab-8854-3cfd0ad2976d req-78cbd1d7-2eef-45c1-8bd3-187ebf61349d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039145 May 23 17:20:38.658148 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 208/405] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:20:38.715515 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b202c277-cf9f-4256-b2f5-0a365d79ef2c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:38.722461 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-89b9808b-330a-4798-a158-86541c8b94b3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:38.723710 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b202c277-cf9f-4256-b2f5-0a365d79ef2c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1358 microversion: 2.1 time: 0.177970 May 23 17:20:38.723987 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-89b9808b-330a-4798-a158-86541c8b94b3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:38.725078 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 198/406] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:38 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:38.731716 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-89b9808b-330a-4798-a158-86541c8b94b3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:38.732188 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-89b9808b-330a-4798-a158-86541c8b94b3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:38.732989 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-89b9808b-330a-4798-a158-86541c8b94b3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:38.733637 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-89b9808b-330a-4798-a158-86541c8b94b3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:38.887400 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-89b9808b-330a-4798-a158-86541c8b94b3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:38.896431 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-89b9808b-330a-4798-a158-86541c8b94b3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:38.897967 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-89b9808b-330a-4798-a158-86541c8b94b3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:38.899132 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-89b9808b-330a-4798-a158-86541c8b94b3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1665 microversion: 2.20 time: 0.181254 May 23 17:20:38.899662 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 209/407] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:20:38 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1665 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 17:20:38.917010 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ecfefa37-e37a-49f3-b47f-ccc97155b0a9 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3dbf6793-e8da-4bb8-b1fe-7daee830a58e"}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:20:38.918147 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ecfefa37-e37a-49f3-b47f-ccc97155b0a9 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:38.925021 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ecfefa37-e37a-49f3-b47f-ccc97155b0a9 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:38.925463 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ecfefa37-e37a-49f3-b47f-ccc97155b0a9 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:38.926224 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ecfefa37-e37a-49f3-b47f-ccc97155b0a9 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:38.926648 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ecfefa37-e37a-49f3-b47f-ccc97155b0a9 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:39.180995 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-af9d73fa-b564-4b66-b023-1f068fcda737 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:39.181609 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-af9d73fa-b564-4b66-b023-1f068fcda737 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:39.187558 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-af9d73fa-b564-4b66-b023-1f068fcda737 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:39.188009 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-af9d73fa-b564-4b66-b023-1f068fcda737 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:39.188805 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-af9d73fa-b564-4b66-b023-1f068fcda737 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:39.189224 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-af9d73fa-b564-4b66-b023-1f068fcda737 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:39.237675 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ecfefa37-e37a-49f3-b47f-ccc97155b0a9 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "POST /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.324718 May 23 17:20:39.238842 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 199/408] 10.222.0.46 () {62 vars in 1363 bytes} [Mon May 23 17:20:38 2022] POST /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091/os-volume_attachments => generated 188 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 17:20:39.321137 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-af9d73fa-b564-4b66-b023-1f068fcda737 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:39.328722 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-af9d73fa-b564-4b66-b023-1f068fcda737 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1370 microversion: 2.1 time: 0.151598 May 23 17:20:39.329336 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 210/409] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:39 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:39.357692 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3eb3d9b8-8611-45ec-bce6-ebb97e1c6cae tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:20:39.358395 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3eb3d9b8-8611-45ec-bce6-ebb97e1c6cae tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:39.364663 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3eb3d9b8-8611-45ec-bce6-ebb97e1c6cae tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:39.365186 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3eb3d9b8-8611-45ec-bce6-ebb97e1c6cae tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:39.365968 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3eb3d9b8-8611-45ec-bce6-ebb97e1c6cae tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:39.366409 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3eb3d9b8-8611-45ec-bce6-ebb97e1c6cae tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:39.380235 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:39.463834 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3eb3d9b8-8611-45ec-bce6-ebb97e1c6cae tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "POST /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091/action" status: 202 len: 0 microversion: 2.20 time: 0.110074 May 23 17:20:39.464442 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 200/410] 10.222.0.46 () {62 vars in 1318 bytes} [Mon May 23 17:20:39 2022] POST /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 17:20:39.472779 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-91ac17cc-bbb2-428b-a7ee-dc3ce3a1aa8e tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:39.473332 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-91ac17cc-bbb2-428b-a7ee-dc3ce3a1aa8e tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:39.479511 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-91ac17cc-bbb2-428b-a7ee-dc3ce3a1aa8e tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:39.479961 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-91ac17cc-bbb2-428b-a7ee-dc3ce3a1aa8e tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:39.480771 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-91ac17cc-bbb2-428b-a7ee-dc3ce3a1aa8e tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:39.481212 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-91ac17cc-bbb2-428b-a7ee-dc3ce3a1aa8e tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:39.740724 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0faacda0-8961-4b66-835e-41893aee833b tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:39.741340 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0faacda0-8961-4b66-835e-41893aee833b tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:39.751865 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0faacda0-8961-4b66-835e-41893aee833b tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:39.752567 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0faacda0-8961-4b66-835e-41893aee833b tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:39.753605 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0faacda0-8961-4b66-835e-41893aee833b tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:39.754192 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0faacda0-8961-4b66-835e-41893aee833b tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:39.878979 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-91ac17cc-bbb2-428b-a7ee-dc3ce3a1aa8e tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:39.888538 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-91ac17cc-bbb2-428b-a7ee-dc3ce3a1aa8e tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:39.890367 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-91ac17cc-bbb2-428b-a7ee-dc3ce3a1aa8e tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:39.891701 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-91ac17cc-bbb2-428b-a7ee-dc3ce3a1aa8e tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1751 microversion: 2.20 time: 0.422951 May 23 17:20:39.892790 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 211/411] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:20:39 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1751 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:20:39.966351 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0faacda0-8961-4b66-835e-41893aee833b tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:39.974381 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0faacda0-8961-4b66-835e-41893aee833b tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1358 microversion: 2.1 time: 0.237682 May 23 17:20:39.974998 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 201/412] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:39 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1358 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:20:40.345891 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-449fbd36-43a9-4ebb-93a4-a32e6b9c4f3c tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:40.346587 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-449fbd36-43a9-4ebb-93a4-a32e6b9c4f3c tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:40.353674 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-449fbd36-43a9-4ebb-93a4-a32e6b9c4f3c tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:40.357103 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-449fbd36-43a9-4ebb-93a4-a32e6b9c4f3c tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:40.358107 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-449fbd36-43a9-4ebb-93a4-a32e6b9c4f3c tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:40.358558 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-449fbd36-43a9-4ebb-93a4-a32e6b9c4f3c tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:40.504665 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-449fbd36-43a9-4ebb-93a4-a32e6b9c4f3c tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:40.513198 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-449fbd36-43a9-4ebb-93a4-a32e6b9c4f3c tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1370 microversion: 2.1 time: 0.170830 May 23 17:20:40.514017 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 212/413] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:40 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:40.913384 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e923743e-b1f2-45b7-9d9b-4537e8686724 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:40.914015 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e923743e-b1f2-45b7-9d9b-4537e8686724 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:40.923338 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e923743e-b1f2-45b7-9d9b-4537e8686724 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:40.923878 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e923743e-b1f2-45b7-9d9b-4537e8686724 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:40.924639 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e923743e-b1f2-45b7-9d9b-4537e8686724 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:40.925081 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e923743e-b1f2-45b7-9d9b-4537e8686724 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:40.991724 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-3aa4ae7e-9224-40c0-b399-579d524d0f8d tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:40.992335 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-3aa4ae7e-9224-40c0-b399-579d524d0f8d tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:40.999306 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3aa4ae7e-9224-40c0-b399-579d524d0f8d tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:40.999763 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3aa4ae7e-9224-40c0-b399-579d524d0f8d tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:41.000539 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3aa4ae7e-9224-40c0-b399-579d524d0f8d tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:41.001040 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3aa4ae7e-9224-40c0-b399-579d524d0f8d tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:41.096235 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e923743e-b1f2-45b7-9d9b-4537e8686724 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:41.106094 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e923743e-b1f2-45b7-9d9b-4537e8686724 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:41.107704 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e923743e-b1f2-45b7-9d9b-4537e8686724 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:41.109221 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e923743e-b1f2-45b7-9d9b-4537e8686724 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1751 microversion: 2.20 time: 0.202083 May 23 17:20:41.110029 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 202/414] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:20:40 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1751 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:20:41.158994 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-3aa4ae7e-9224-40c0-b399-579d524d0f8d tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:41.170484 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-3aa4ae7e-9224-40c0-b399-579d524d0f8d tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1358 microversion: 2.1 time: 0.182376 May 23 17:20:41.171226 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 213/415] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:40 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:41.532468 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-89177a7a-1671-4a30-aa7d-1880d5e41087 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:41.533116 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-89177a7a-1671-4a30-aa7d-1880d5e41087 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:41.539965 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-89177a7a-1671-4a30-aa7d-1880d5e41087 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:41.540414 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-89177a7a-1671-4a30-aa7d-1880d5e41087 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:41.541204 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-89177a7a-1671-4a30-aa7d-1880d5e41087 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:41.541629 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-89177a7a-1671-4a30-aa7d-1880d5e41087 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:41.673055 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-89177a7a-1671-4a30-aa7d-1880d5e41087 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:41.680570 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-89177a7a-1671-4a30-aa7d-1880d5e41087 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1370 microversion: 2.1 time: 0.153051 May 23 17:20:41.681170 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 203/416] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:41 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:42.127696 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-ecfb86ea-ed2a-473f-b8cc-2d766f0baa72 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:42.128347 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-ecfb86ea-ed2a-473f-b8cc-2d766f0baa72 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:42.135605 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ecfb86ea-ed2a-473f-b8cc-2d766f0baa72 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:42.136053 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ecfb86ea-ed2a-473f-b8cc-2d766f0baa72 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:42.136860 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ecfb86ea-ed2a-473f-b8cc-2d766f0baa72 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:42.137287 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ecfb86ea-ed2a-473f-b8cc-2d766f0baa72 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:42.190003 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-49a780cf-49e5-47fa-be6e-88b6be97597c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:42.190571 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-49a780cf-49e5-47fa-be6e-88b6be97597c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:42.196935 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-49a780cf-49e5-47fa-be6e-88b6be97597c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:42.197440 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-49a780cf-49e5-47fa-be6e-88b6be97597c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:42.198204 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-49a780cf-49e5-47fa-be6e-88b6be97597c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:42.198617 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-49a780cf-49e5-47fa-be6e-88b6be97597c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:42.315177 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ecfb86ea-ed2a-473f-b8cc-2d766f0baa72 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:42.326793 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ecfb86ea-ed2a-473f-b8cc-2d766f0baa72 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:42.329052 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ecfb86ea-ed2a-473f-b8cc-2d766f0baa72 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:42.330464 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-ecfb86ea-ed2a-473f-b8cc-2d766f0baa72 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1751 microversion: 2.20 time: 0.206638 May 23 17:20:42.331469 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 214/417] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:20:42 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1751 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:20:42.362687 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-49a780cf-49e5-47fa-be6e-88b6be97597c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:42.370190 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-49a780cf-49e5-47fa-be6e-88b6be97597c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1358 microversion: 2.1 time: 0.184496 May 23 17:20:42.370763 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 204/418] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:42 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:42.700068 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-30cc13a7-2710-4ee6-9b28-0fd24dbca342 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:42.701743 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-30cc13a7-2710-4ee6-9b28-0fd24dbca342 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:42.710475 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-30cc13a7-2710-4ee6-9b28-0fd24dbca342 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:42.711006 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-30cc13a7-2710-4ee6-9b28-0fd24dbca342 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:42.711770 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-30cc13a7-2710-4ee6-9b28-0fd24dbca342 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:42.712197 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-30cc13a7-2710-4ee6-9b28-0fd24dbca342 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:42.925342 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-30cc13a7-2710-4ee6-9b28-0fd24dbca342 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:42.934507 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-30cc13a7-2710-4ee6-9b28-0fd24dbca342 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1370 microversion: 2.1 time: 0.240019 May 23 17:20:42.936137 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 215/419] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:42 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1370 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:43.352284 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-16295f74-7419-4996-be30-5555bd6fd894 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:43.355080 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-16295f74-7419-4996-be30-5555bd6fd894 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:43.376239 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-16295f74-7419-4996-be30-5555bd6fd894 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:43.377118 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-16295f74-7419-4996-be30-5555bd6fd894 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:43.383353 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-16295f74-7419-4996-be30-5555bd6fd894 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:43.383972 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-16295f74-7419-4996-be30-5555bd6fd894 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:43.387323 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-56f17101-3212-4730-b56a-8696cc70a601 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:43.388410 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-56f17101-3212-4730-b56a-8696cc70a601 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:43.402803 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-56f17101-3212-4730-b56a-8696cc70a601 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:43.403361 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-56f17101-3212-4730-b56a-8696cc70a601 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:43.404265 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-56f17101-3212-4730-b56a-8696cc70a601 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:43.405921 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-56f17101-3212-4730-b56a-8696cc70a601 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:43.473417 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=100 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:43.768983 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-16295f74-7419-4996-be30-5555bd6fd894 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:43.786197 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-16295f74-7419-4996-be30-5555bd6fd894 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:43.788080 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-16295f74-7419-4996-be30-5555bd6fd894 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:43.790206 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-56f17101-3212-4730-b56a-8696cc70a601 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:43.790447 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-16295f74-7419-4996-be30-5555bd6fd894 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1753 microversion: 2.20 time: 0.445202 May 23 17:20:43.791334 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 205/420] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:20:43 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1753 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:20:43.810172 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-56f17101-3212-4730-b56a-8696cc70a601 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1358 microversion: 2.1 time: 0.426908 May 23 17:20:43.820841 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 216/421] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:43 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1358 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:43.953065 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-19de44c2-7c08-4576-845f-91bf9bec39f4 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:43.954122 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-19de44c2-7c08-4576-845f-91bf9bec39f4 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:43.961150 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-19de44c2-7c08-4576-845f-91bf9bec39f4 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:43.961600 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-19de44c2-7c08-4576-845f-91bf9bec39f4 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:43.962382 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-19de44c2-7c08-4576-845f-91bf9bec39f4 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:43.962818 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-19de44c2-7c08-4576-845f-91bf9bec39f4 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:44.190680 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-19de44c2-7c08-4576-845f-91bf9bec39f4 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:44.199292 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-19de44c2-7c08-4576-845f-91bf9bec39f4 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1370 microversion: 2.1 time: 0.250428 May 23 17:20:44.209571 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 206/422] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:43 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1370 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:44.815256 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-81528e07-d286-44d3-a765-a5a6276d2873 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:44.815928 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-81528e07-d286-44d3-a765-a5a6276d2873 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:44.833673 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-81528e07-d286-44d3-a765-a5a6276d2873 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:44.856259 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-81528e07-d286-44d3-a765-a5a6276d2873 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:44.857288 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-81528e07-d286-44d3-a765-a5a6276d2873 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:44.857741 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-81528e07-d286-44d3-a765-a5a6276d2873 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:44.860875 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b99987bf-1332-4ef9-aff9-8688bf24afb3 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:44.862410 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b99987bf-1332-4ef9-aff9-8688bf24afb3 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:44.876006 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b99987bf-1332-4ef9-aff9-8688bf24afb3 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:44.878300 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b99987bf-1332-4ef9-aff9-8688bf24afb3 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:44.879774 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b99987bf-1332-4ef9-aff9-8688bf24afb3 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:44.881508 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b99987bf-1332-4ef9-aff9-8688bf24afb3 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:45.182433 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b99987bf-1332-4ef9-aff9-8688bf24afb3 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:45.191201 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b99987bf-1332-4ef9-aff9-8688bf24afb3 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1549 microversion: 2.1 time: 0.360746 May 23 17:20:45.191850 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 207/423] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:44 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1549 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:45.207573 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-81528e07-d286-44d3-a765-a5a6276d2873 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:45.221253 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e69f8a62-dc83-41fc-9f16-7c79b01ac20d tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:45.224748 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-81528e07-d286-44d3-a765-a5a6276d2873 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:45.227096 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-81528e07-d286-44d3-a765-a5a6276d2873 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:45.228522 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-81528e07-d286-44d3-a765-a5a6276d2873 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1809 microversion: 2.20 time: 0.418927 May 23 17:20:45.229459 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e69f8a62-dc83-41fc-9f16-7c79b01ac20d tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:45.232881 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 217/424] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:20:44 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1809 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:20:45.248648 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-8c9e442a-540d-4393-b66c-a18d315f6049 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:45.251848 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e69f8a62-dc83-41fc-9f16-7c79b01ac20d tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:45.252788 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-8c9e442a-540d-4393-b66c-a18d315f6049 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:45.253803 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e69f8a62-dc83-41fc-9f16-7c79b01ac20d tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:45.255860 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e69f8a62-dc83-41fc-9f16-7c79b01ac20d tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:45.259332 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e69f8a62-dc83-41fc-9f16-7c79b01ac20d tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:45.279063 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8c9e442a-540d-4393-b66c-a18d315f6049 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:45.279529 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8c9e442a-540d-4393-b66c-a18d315f6049 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:45.280562 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8c9e442a-540d-4393-b66c-a18d315f6049 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:45.281038 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8c9e442a-540d-4393-b66c-a18d315f6049 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:45.572235 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e69f8a62-dc83-41fc-9f16-7c79b01ac20d tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:45.579913 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-8c9e442a-540d-4393-b66c-a18d315f6049 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:45.580954 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e69f8a62-dc83-41fc-9f16-7c79b01ac20d tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1549 microversion: 2.1 time: 0.376611 May 23 17:20:45.590429 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-8c9e442a-540d-4393-b66c-a18d315f6049 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1370 microversion: 2.1 time: 0.356313 May 23 17:20:45.596028 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 218/425] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:45 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1370 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:45.601293 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c7dc1f95-2a6e-4d05-97ad-fc3fce8e1a3c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:45.609967 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 208/426] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:45 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1549 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:45.612953 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-c7dc1f95-2a6e-4d05-97ad-fc3fce8e1a3c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:45.616479 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c7dc1f95-2a6e-4d05-97ad-fc3fce8e1a3c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Searching by: {'deleted': False, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042'} {{(pid=117910) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 23 17:20:45.624447 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c7dc1f95-2a6e-4d05-97ad-fc3fce8e1a3c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:45.625388 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c7dc1f95-2a6e-4d05-97ad-fc3fce8e1a3c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:45.636544 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c7dc1f95-2a6e-4d05-97ad-fc3fce8e1a3c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:45.637325 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c7dc1f95-2a6e-4d05-97ad-fc3fce8e1a3c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:45.803625 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.multi_cell_list [None req-c7dc1f95-2a6e-4d05-97ad-fc3fce8e1a3c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117910) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 23 17:20:45.913238 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c7dc1f95-2a6e-4d05-97ad-fc3fce8e1a3c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.315639 May 23 17:20:45.915077 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 219/427] 10.222.0.46 () {58 vars in 1124 bytes} [Mon May 23 17:20:45 2022] GET /compute/v2.1/servers => generated 342 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:20:45.925492 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-660570b6-590b-4930-a8fb-9633c9dadf4b tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:45.926140 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-660570b6-590b-4930-a8fb-9633c9dadf4b tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:45.932503 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-660570b6-590b-4930-a8fb-9633c9dadf4b tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:45.932973 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-660570b6-590b-4930-a8fb-9633c9dadf4b tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:45.933826 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-660570b6-590b-4930-a8fb-9633c9dadf4b tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:45.934526 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-660570b6-590b-4930-a8fb-9633c9dadf4b tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:46.103607 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-660570b6-590b-4930-a8fb-9633c9dadf4b tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:46.125264 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-660570b6-590b-4930-a8fb-9633c9dadf4b tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1549 microversion: 2.1 time: 0.203665 May 23 17:20:46.126750 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 209/428] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:45 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1549 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:46.251642 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d453cf9c-5065-4ee2-a820-f1e26dd36d67 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:46.252257 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d453cf9c-5065-4ee2-a820-f1e26dd36d67 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:46.261408 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d453cf9c-5065-4ee2-a820-f1e26dd36d67 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:46.262068 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d453cf9c-5065-4ee2-a820-f1e26dd36d67 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:46.263618 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d453cf9c-5065-4ee2-a820-f1e26dd36d67 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:46.264243 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d453cf9c-5065-4ee2-a820-f1e26dd36d67 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:46.504764 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d453cf9c-5065-4ee2-a820-f1e26dd36d67 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:46.530245 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d453cf9c-5065-4ee2-a820-f1e26dd36d67 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:46.533079 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d453cf9c-5065-4ee2-a820-f1e26dd36d67 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:46.535275 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d453cf9c-5065-4ee2-a820-f1e26dd36d67 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1809 microversion: 2.20 time: 0.287792 May 23 17:20:46.536817 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 220/429] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:20:46 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1809 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:20:46.613670 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-35f385c0-c2af-49c8-9549-49271ab9c3a6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:46.614433 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-35f385c0-c2af-49c8-9549-49271ab9c3a6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:46.626762 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-35f385c0-c2af-49c8-9549-49271ab9c3a6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:46.631201 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-35f385c0-c2af-49c8-9549-49271ab9c3a6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:46.633202 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-35f385c0-c2af-49c8-9549-49271ab9c3a6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:46.633991 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-35f385c0-c2af-49c8-9549-49271ab9c3a6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:46.785400 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-264fd808-1af8-4e9a-8f42-57f071048230 req-f85301fe-b837-4ca1-a96a-07d3b6a55ee4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c26b20b6-8a97-4aa1-af83-616cc09c9165", "name": "network-vif-plugged", "status": "completed", "tag": "b66d0e22-835b-4627-b12b-de1e251bd6e9"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:20:46.798009 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-264fd808-1af8-4e9a-8f42-57f071048230 req-f85301fe-b837-4ca1-a96a-07d3b6a55ee4 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:46.798810 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-264fd808-1af8-4e9a-8f42-57f071048230 req-f85301fe-b837-4ca1-a96a-07d3b6a55ee4 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:46.815980 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-264fd808-1af8-4e9a-8f42-57f071048230 req-f85301fe-b837-4ca1-a96a-07d3b6a55ee4 service nova] Creating event network-vif-plugged:b66d0e22-835b-4627-b12b-de1e251bd6e9 for instance c26b20b6-8a97-4aa1-af83-616cc09c9165 on hv-cinder-84299 May 23 17:20:46.821285 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-264fd808-1af8-4e9a-8f42-57f071048230 req-f85301fe-b837-4ca1-a96a-07d3b6a55ee4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039986 May 23 17:20:46.822207 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 221/430] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 17:20:46.921622 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-35f385c0-c2af-49c8-9549-49271ab9c3a6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:46.939911 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-35f385c0-c2af-49c8-9549-49271ab9c3a6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1370 microversion: 2.1 time: 0.331980 May 23 17:20:46.948990 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 210/431] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:46 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1370 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:47.557310 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-9fd9d0fd-3a8d-40d9-bff8-bf591ccbfeca tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:47.557913 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-9fd9d0fd-3a8d-40d9-bff8-bf591ccbfeca tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:47.564781 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9fd9d0fd-3a8d-40d9-bff8-bf591ccbfeca tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:47.565228 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9fd9d0fd-3a8d-40d9-bff8-bf591ccbfeca tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:47.566334 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9fd9d0fd-3a8d-40d9-bff8-bf591ccbfeca tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:47.566955 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9fd9d0fd-3a8d-40d9-bff8-bf591ccbfeca tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:47.740779 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9fd9d0fd-3a8d-40d9-bff8-bf591ccbfeca tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:47.751261 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9fd9d0fd-3a8d-40d9-bff8-bf591ccbfeca tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:47.753110 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9fd9d0fd-3a8d-40d9-bff8-bf591ccbfeca tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:47.754711 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-9fd9d0fd-3a8d-40d9-bff8-bf591ccbfeca tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1809 microversion: 2.20 time: 0.202593 May 23 17:20:47.755698 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 222/432] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:20:47 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1809 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:20:47.919543 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-843d4406-dd1b-499a-abc6-a7fdba42cf61 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "daa76b23-d1c8-41f0-88f6-d3966a9062d1"}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:20:47.920887 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-843d4406-dd1b-499a-abc6-a7fdba42cf61 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:47.930693 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-843d4406-dd1b-499a-abc6-a7fdba42cf61 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:47.931270 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-843d4406-dd1b-499a-abc6-a7fdba42cf61 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:47.932145 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-843d4406-dd1b-499a-abc6-a7fdba42cf61 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:47.932679 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-843d4406-dd1b-499a-abc6-a7fdba42cf61 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:47.957740 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d5d4a71f-a166-4a3b-988c-6afd2d857c39 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:47.958392 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d5d4a71f-a166-4a3b-988c-6afd2d857c39 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:47.966099 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d5d4a71f-a166-4a3b-988c-6afd2d857c39 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:47.966850 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d5d4a71f-a166-4a3b-988c-6afd2d857c39 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:47.968649 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d5d4a71f-a166-4a3b-988c-6afd2d857c39 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:47.969443 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d5d4a71f-a166-4a3b-988c-6afd2d857c39 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:48.121953 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d5d4a71f-a166-4a3b-988c-6afd2d857c39 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:48.130273 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d5d4a71f-a166-4a3b-988c-6afd2d857c39 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1370 microversion: 2.1 time: 0.176584 May 23 17:20:48.130870 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 223/433] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:47 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:20:48.525177 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-843d4406-dd1b-499a-abc6-a7fdba42cf61 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "POST /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.609975 May 23 17:20:48.525906 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 211/434] 10.222.0.46 () {60 vars in 1322 bytes} [Mon May 23 17:20:47 2022] POST /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2/os-volume_attachments => generated 194 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:20:48.774311 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c9936610-acdc-4d01-b6da-5b70e167c3ab tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:48.774981 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c9936610-acdc-4d01-b6da-5b70e167c3ab tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:48.782319 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c9936610-acdc-4d01-b6da-5b70e167c3ab tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:48.782566 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c9936610-acdc-4d01-b6da-5b70e167c3ab tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:48.783351 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c9936610-acdc-4d01-b6da-5b70e167c3ab tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:48.783827 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c9936610-acdc-4d01-b6da-5b70e167c3ab tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:48.951965 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-c9936610-acdc-4d01-b6da-5b70e167c3ab tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:48.967987 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-c9936610-acdc-4d01-b6da-5b70e167c3ab tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:48.970069 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-c9936610-acdc-4d01-b6da-5b70e167c3ab tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:48.972850 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c9936610-acdc-4d01-b6da-5b70e167c3ab tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1809 microversion: 2.20 time: 0.201017 May 23 17:20:48.982868 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 224/435] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:20:48 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1809 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:20:49.148228 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-046860cc-aee2-4b86-8c91-cc454f5a33b9 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:49.148964 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-046860cc-aee2-4b86-8c91-cc454f5a33b9 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:49.156510 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-046860cc-aee2-4b86-8c91-cc454f5a33b9 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:49.157003 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-046860cc-aee2-4b86-8c91-cc454f5a33b9 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:49.157777 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-046860cc-aee2-4b86-8c91-cc454f5a33b9 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:49.158209 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-046860cc-aee2-4b86-8c91-cc454f5a33b9 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:49.297155 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-046860cc-aee2-4b86-8c91-cc454f5a33b9 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:49.304767 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-046860cc-aee2-4b86-8c91-cc454f5a33b9 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1564 microversion: 2.1 time: 0.161023 May 23 17:20:49.305331 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 212/436] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:20:49 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:20:49.321913 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e98f34b3-3060-456e-9d45-5e8680069d15 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:49.322410 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-e98f34b3-3060-456e-9d45-5e8680069d15 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:49.329124 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e98f34b3-3060-456e-9d45-5e8680069d15 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:49.329576 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e98f34b3-3060-456e-9d45-5e8680069d15 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:49.330384 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e98f34b3-3060-456e-9d45-5e8680069d15 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:49.330997 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e98f34b3-3060-456e-9d45-5e8680069d15 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:49.424061 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-e98f34b3-3060-456e-9d45-5e8680069d15 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105864 May 23 17:20:49.428096 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 225/437] 10.222.0.46 () {58 vars in 1274 bytes} [Mon May 23 17:20:49 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:20:49.992015 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f3a6bd57-9dbe-4b0d-b42d-94d909bd0a59 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:49.993281 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f3a6bd57-9dbe-4b0d-b42d-94d909bd0a59 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:50.002098 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f3a6bd57-9dbe-4b0d-b42d-94d909bd0a59 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:50.002871 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f3a6bd57-9dbe-4b0d-b42d-94d909bd0a59 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:50.003820 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f3a6bd57-9dbe-4b0d-b42d-94d909bd0a59 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:50.004406 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f3a6bd57-9dbe-4b0d-b42d-94d909bd0a59 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:50.555633 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f3a6bd57-9dbe-4b0d-b42d-94d909bd0a59 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:50.565495 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f3a6bd57-9dbe-4b0d-b42d-94d909bd0a59 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:50.567196 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f3a6bd57-9dbe-4b0d-b42d-94d909bd0a59 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:50.568450 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f3a6bd57-9dbe-4b0d-b42d-94d909bd0a59 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1809 microversion: 2.20 time: 0.582554 May 23 17:20:50.569607 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 213/438] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:20:49 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1809 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:20:50.914725 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-073a15d1-a7ce-44d9-bed2-eae5b7736e50 req-338f37a2-54e7-48e2-a534-ae20033b08ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c26b20b6-8a97-4aa1-af83-616cc09c9165", "tag": "b66d0e22-835b-4627-b12b-de1e251bd6e9"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:20:50.934810 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-073a15d1-a7ce-44d9-bed2-eae5b7736e50 req-338f37a2-54e7-48e2-a534-ae20033b08ad service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:50.943761 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-073a15d1-a7ce-44d9-bed2-eae5b7736e50 req-338f37a2-54e7-48e2-a534-ae20033b08ad service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:50.995528 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-073a15d1-a7ce-44d9-bed2-eae5b7736e50 req-338f37a2-54e7-48e2-a534-ae20033b08ad service nova] Creating event network-changed:b66d0e22-835b-4627-b12b-de1e251bd6e9 for instance c26b20b6-8a97-4aa1-af83-616cc09c9165 on hv-cinder-84299 May 23 17:20:51.002240 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-073a15d1-a7ce-44d9-bed2-eae5b7736e50 req-338f37a2-54e7-48e2-a534-ae20033b08ad service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098793 May 23 17:20:51.003254 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 226/439] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:20:51.589754 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3bccfbca-7130-4870-a150-ed19882a705c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:51.591238 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3bccfbca-7130-4870-a150-ed19882a705c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:51.600092 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3bccfbca-7130-4870-a150-ed19882a705c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:51.601066 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3bccfbca-7130-4870-a150-ed19882a705c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:51.602105 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3bccfbca-7130-4870-a150-ed19882a705c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:51.602751 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3bccfbca-7130-4870-a150-ed19882a705c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:51.972999 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3bccfbca-7130-4870-a150-ed19882a705c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:51.980675 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:52.005036 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3bccfbca-7130-4870-a150-ed19882a705c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:52.014004 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3bccfbca-7130-4870-a150-ed19882a705c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:52.016319 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3bccfbca-7130-4870-a150-ed19882a705c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1809 microversion: 2.20 time: 0.431272 May 23 17:20:52.018753 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 214/440] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:20:51 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1809 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:20:53.040272 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2cb4cabb-1a58-42ed-b7bb-b49fc180fc79 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:53.042215 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2cb4cabb-1a58-42ed-b7bb-b49fc180fc79 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:53.058862 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=98 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:53.060944 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2cb4cabb-1a58-42ed-b7bb-b49fc180fc79 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:53.062990 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2cb4cabb-1a58-42ed-b7bb-b49fc180fc79 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:53.062990 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2cb4cabb-1a58-42ed-b7bb-b49fc180fc79 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:53.072256 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2cb4cabb-1a58-42ed-b7bb-b49fc180fc79 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:53.381744 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2cb4cabb-1a58-42ed-b7bb-b49fc180fc79 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:53.398524 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2cb4cabb-1a58-42ed-b7bb-b49fc180fc79 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:53.400739 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2cb4cabb-1a58-42ed-b7bb-b49fc180fc79 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:53.402027 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2cb4cabb-1a58-42ed-b7bb-b49fc180fc79 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1809 microversion: 2.20 time: 0.366281 May 23 17:20:53.405508 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 227/441] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:20:53 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1809 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 17:20:54.425005 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9d3b076d-49f6-43ef-ada2-7b34f1dcfa74 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:54.427502 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9d3b076d-49f6-43ef-ada2-7b34f1dcfa74 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:54.458603 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9d3b076d-49f6-43ef-ada2-7b34f1dcfa74 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:54.459426 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9d3b076d-49f6-43ef-ada2-7b34f1dcfa74 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:54.460500 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9d3b076d-49f6-43ef-ada2-7b34f1dcfa74 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:54.461189 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9d3b076d-49f6-43ef-ada2-7b34f1dcfa74 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:54.681300 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9d3b076d-49f6-43ef-ada2-7b34f1dcfa74 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:54.695857 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9d3b076d-49f6-43ef-ada2-7b34f1dcfa74 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:54.698001 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9d3b076d-49f6-43ef-ada2-7b34f1dcfa74 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:54.699945 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9d3b076d-49f6-43ef-ada2-7b34f1dcfa74 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1809 microversion: 2.20 time: 0.279952 May 23 17:20:54.713171 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 215/442] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:20:54 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1809 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:20:55.720197 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-29e02b4a-cb82-4585-8a91-a56fa32097b7 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:55.722134 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-29e02b4a-cb82-4585-8a91-a56fa32097b7 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:55.729782 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=2 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:55.738051 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-29e02b4a-cb82-4585-8a91-a56fa32097b7 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:55.738845 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-29e02b4a-cb82-4585-8a91-a56fa32097b7 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:55.739892 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-29e02b4a-cb82-4585-8a91-a56fa32097b7 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:55.740420 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-29e02b4a-cb82-4585-8a91-a56fa32097b7 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:55.936338 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-29e02b4a-cb82-4585-8a91-a56fa32097b7 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:55.945354 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-29e02b4a-cb82-4585-8a91-a56fa32097b7 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:55.946937 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-29e02b4a-cb82-4585-8a91-a56fa32097b7 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:55.948284 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-29e02b4a-cb82-4585-8a91-a56fa32097b7 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1809 microversion: 2.20 time: 0.232063 May 23 17:20:55.949322 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 228/443] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:20:55 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1809 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:20:56.969825 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-32f7fff1-00c3-4002-abeb-851632b2904a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:56.971414 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-32f7fff1-00c3-4002-abeb-851632b2904a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:56.980628 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-32f7fff1-00c3-4002-abeb-851632b2904a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:56.981499 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-32f7fff1-00c3-4002-abeb-851632b2904a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:56.982635 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-32f7fff1-00c3-4002-abeb-851632b2904a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:56.983181 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-32f7fff1-00c3-4002-abeb-851632b2904a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:57.234665 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-32f7fff1-00c3-4002-abeb-851632b2904a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:57.244651 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-32f7fff1-00c3-4002-abeb-851632b2904a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:57.246596 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-32f7fff1-00c3-4002-abeb-851632b2904a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:57.247977 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-32f7fff1-00c3-4002-abeb-851632b2904a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1809 microversion: 2.20 time: 0.285856 May 23 17:20:57.248971 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 216/444] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:20:56 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1809 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:20:58.267859 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-12c5bb53-e95e-4bee-8986-25a2adda7c19 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:58.268470 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-12c5bb53-e95e-4bee-8986-25a2adda7c19 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:58.276147 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-12c5bb53-e95e-4bee-8986-25a2adda7c19 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:58.276848 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-12c5bb53-e95e-4bee-8986-25a2adda7c19 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:58.277888 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-12c5bb53-e95e-4bee-8986-25a2adda7c19 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:58.278426 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-12c5bb53-e95e-4bee-8986-25a2adda7c19 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:58.513540 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-12c5bb53-e95e-4bee-8986-25a2adda7c19 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:58.522445 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-12c5bb53-e95e-4bee-8986-25a2adda7c19 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:58.525840 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-12c5bb53-e95e-4bee-8986-25a2adda7c19 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:58.527054 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-12c5bb53-e95e-4bee-8986-25a2adda7c19 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1809 microversion: 2.20 time: 0.263275 May 23 17:20:58.527908 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 229/445] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:20:58 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1809 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:20:59.546802 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0fa55569-38b1-4c14-a062-1439a998618d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:20:59.547591 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0fa55569-38b1-4c14-a062-1439a998618d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:20:59.554946 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=78 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:20:59.557540 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0fa55569-38b1-4c14-a062-1439a998618d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:59.558794 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0fa55569-38b1-4c14-a062-1439a998618d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:59.559996 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0fa55569-38b1-4c14-a062-1439a998618d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:20:59.560678 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0fa55569-38b1-4c14-a062-1439a998618d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:20:59.749322 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0fa55569-38b1-4c14-a062-1439a998618d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:59.765385 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0fa55569-38b1-4c14-a062-1439a998618d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:59.767400 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0fa55569-38b1-4c14-a062-1439a998618d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:20:59.768971 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0fa55569-38b1-4c14-a062-1439a998618d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1809 microversion: 2.20 time: 0.226948 May 23 17:20:59.770132 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 217/446] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:20:59 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1809 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:21:00.799961 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a428a111-90a5-431a-b280-e6acef213f68 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:00.801073 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-a428a111-90a5-431a-b280-e6acef213f68 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:00.821437 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a428a111-90a5-431a-b280-e6acef213f68 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:00.822078 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a428a111-90a5-431a-b280-e6acef213f68 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:00.823100 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a428a111-90a5-431a-b280-e6acef213f68 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:00.824989 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a428a111-90a5-431a-b280-e6acef213f68 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:01.214344 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a428a111-90a5-431a-b280-e6acef213f68 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:01.227680 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a428a111-90a5-431a-b280-e6acef213f68 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:01.229993 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a428a111-90a5-431a-b280-e6acef213f68 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:01.231598 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-a428a111-90a5-431a-b280-e6acef213f68 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1809 microversion: 2.20 time: 0.436223 May 23 17:21:01.242697 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 230/447] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:21:00 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1809 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:21:02.252376 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9a33c302-d91f-4fe9-989b-a173b78a71e8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:02.253055 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9a33c302-d91f-4fe9-989b-a173b78a71e8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:02.259481 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9a33c302-d91f-4fe9-989b-a173b78a71e8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:02.259924 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9a33c302-d91f-4fe9-989b-a173b78a71e8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:02.260710 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9a33c302-d91f-4fe9-989b-a173b78a71e8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:02.261362 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9a33c302-d91f-4fe9-989b-a173b78a71e8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:02.441660 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9a33c302-d91f-4fe9-989b-a173b78a71e8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:02.454565 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9a33c302-d91f-4fe9-989b-a173b78a71e8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:02.456587 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9a33c302-d91f-4fe9-989b-a173b78a71e8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:02.458065 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9a33c302-d91f-4fe9-989b-a173b78a71e8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1809 microversion: 2.20 time: 0.209763 May 23 17:21:02.470339 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 218/448] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:21:02 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1809 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:21:03.476968 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-602f4af7-0383-4c95-9fd8-02a234a05e6d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:03.477602 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-602f4af7-0383-4c95-9fd8-02a234a05e6d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:03.484788 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-602f4af7-0383-4c95-9fd8-02a234a05e6d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:03.485233 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-602f4af7-0383-4c95-9fd8-02a234a05e6d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:03.486001 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-602f4af7-0383-4c95-9fd8-02a234a05e6d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:03.486430 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-602f4af7-0383-4c95-9fd8-02a234a05e6d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:03.625794 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-602f4af7-0383-4c95-9fd8-02a234a05e6d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:03.634835 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-602f4af7-0383-4c95-9fd8-02a234a05e6d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:03.636362 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-602f4af7-0383-4c95-9fd8-02a234a05e6d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:03.638354 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-602f4af7-0383-4c95-9fd8-02a234a05e6d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1809 microversion: 2.20 time: 0.164704 May 23 17:21:03.640071 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 231/449] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:21:03 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:21:04.661041 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-94c1a6d5-18a9-4294-a56d-ee1294f24a46 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:04.661682 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-94c1a6d5-18a9-4294-a56d-ee1294f24a46 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:04.669016 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-94c1a6d5-18a9-4294-a56d-ee1294f24a46 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:04.669455 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-94c1a6d5-18a9-4294-a56d-ee1294f24a46 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:04.670206 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-94c1a6d5-18a9-4294-a56d-ee1294f24a46 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:04.670632 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-94c1a6d5-18a9-4294-a56d-ee1294f24a46 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:04.825991 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-94c1a6d5-18a9-4294-a56d-ee1294f24a46 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:04.837670 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-94c1a6d5-18a9-4294-a56d-ee1294f24a46 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:04.840577 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-94c1a6d5-18a9-4294-a56d-ee1294f24a46 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:04.842402 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-94c1a6d5-18a9-4294-a56d-ee1294f24a46 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1809 microversion: 2.20 time: 0.185248 May 23 17:21:04.843238 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 219/450] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:21:04 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:21:05.228083 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-62013387-7d1b-43ed-b324-d0c5006ce370 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:05.228703 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-62013387-7d1b-43ed-b324-d0c5006ce370 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:05.235208 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-62013387-7d1b-43ed-b324-d0c5006ce370 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:05.235652 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-62013387-7d1b-43ed-b324-d0c5006ce370 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:05.236411 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-62013387-7d1b-43ed-b324-d0c5006ce370 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:05.236883 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-62013387-7d1b-43ed-b324-d0c5006ce370 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:05.378715 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-62013387-7d1b-43ed-b324-d0c5006ce370 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:05.391638 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-62013387-7d1b-43ed-b324-d0c5006ce370 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1595 microversion: 2.1 time: 0.168105 May 23 17:21:05.392199 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 232/451] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:21:05 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1595 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:21:05.863381 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-99649e3f-3f5e-4fa4-a563-d370c2fbcd1c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:05.864577 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-99649e3f-3f5e-4fa4-a563-d370c2fbcd1c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:05.872102 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-99649e3f-3f5e-4fa4-a563-d370c2fbcd1c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:05.872552 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-99649e3f-3f5e-4fa4-a563-d370c2fbcd1c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:05.873373 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-99649e3f-3f5e-4fa4-a563-d370c2fbcd1c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:05.874010 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-99649e3f-3f5e-4fa4-a563-d370c2fbcd1c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:06.026110 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-99649e3f-3f5e-4fa4-a563-d370c2fbcd1c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:06.038449 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-99649e3f-3f5e-4fa4-a563-d370c2fbcd1c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:06.040685 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-99649e3f-3f5e-4fa4-a563-d370c2fbcd1c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:06.042425 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-99649e3f-3f5e-4fa4-a563-d370c2fbcd1c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1809 microversion: 2.20 time: 0.183004 May 23 17:21:06.052638 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 220/452] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:21:05 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:21:07.064904 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-5470d811-1fe0-469b-9d04-590c8b37f844 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:07.065524 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-5470d811-1fe0-469b-9d04-590c8b37f844 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:07.072559 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5470d811-1fe0-469b-9d04-590c8b37f844 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:07.073049 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5470d811-1fe0-469b-9d04-590c8b37f844 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:07.073889 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5470d811-1fe0-469b-9d04-590c8b37f844 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:07.074324 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5470d811-1fe0-469b-9d04-590c8b37f844 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:07.241544 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-5470d811-1fe0-469b-9d04-590c8b37f844 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:07.250371 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-5470d811-1fe0-469b-9d04-590c8b37f844 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:07.251877 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-5470d811-1fe0-469b-9d04-590c8b37f844 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:07.253081 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-5470d811-1fe0-469b-9d04-590c8b37f844 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1809 microversion: 2.20 time: 0.193043 May 23 17:21:07.253653 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 233/453] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:21:07 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:21:07.711206 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-c86ab365-c7cc-4516-a99a-87e91d63e016 req-29d177d5-7459-4f73-bd27-75b72d98808f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c6c849e-492f-4bd4-91d8-f1622420a3d2", "tag": "b64de995-4ddd-4471-a42a-480203d490ce"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:21:07.720884 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-c86ab365-c7cc-4516-a99a-87e91d63e016 req-29d177d5-7459-4f73-bd27-75b72d98808f service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:07.721320 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-c86ab365-c7cc-4516-a99a-87e91d63e016 req-29d177d5-7459-4f73-bd27-75b72d98808f service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:07.732922 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-c86ab365-c7cc-4516-a99a-87e91d63e016 req-29d177d5-7459-4f73-bd27-75b72d98808f service nova] Creating event network-changed:b64de995-4ddd-4471-a42a-480203d490ce for instance 7c6c849e-492f-4bd4-91d8-f1622420a3d2 on hv-cinder-84299 May 23 17:21:07.739023 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-c86ab365-c7cc-4516-a99a-87e91d63e016 req-29d177d5-7459-4f73-bd27-75b72d98808f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032007 May 23 17:21:07.739624 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 221/454] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:21:07.830573 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-170155ee-a79b-437b-8360-34039efb0d18 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "198e0794-f4be-42db-80e7-a52105d3f13e", "device": "/dev/sdb"}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:21:07.832658 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-170155ee-a79b-437b-8360-34039efb0d18 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 6664de84-4c36-42da-9577-594b6bc73fec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:07.839601 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-170155ee-a79b-437b-8360-34039efb0d18 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:07.840052 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-170155ee-a79b-437b-8360-34039efb0d18 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:07.841232 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-170155ee-a79b-437b-8360-34039efb0d18 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:07.841876 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-170155ee-a79b-437b-8360-34039efb0d18 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:07.856262 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=100 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:21:08.179956 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-170155ee-a79b-437b-8360-34039efb0d18 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "POST /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.358955 May 23 17:21:08.187840 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 234/455] 10.222.0.46 () {60 vars in 1322 bytes} [Mon May 23 17:21:07 2022] POST /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec/os-volume_attachments => generated 194 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:21:08.277867 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7ae35d57-596b-4709-a873-2a94e08bdc22 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:08.278838 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7ae35d57-596b-4709-a873-2a94e08bdc22 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:08.288658 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7ae35d57-596b-4709-a873-2a94e08bdc22 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:08.289353 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7ae35d57-596b-4709-a873-2a94e08bdc22 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:08.290153 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7ae35d57-596b-4709-a873-2a94e08bdc22 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:08.290760 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7ae35d57-596b-4709-a873-2a94e08bdc22 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:08.547877 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7ae35d57-596b-4709-a873-2a94e08bdc22 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:08.560220 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7ae35d57-596b-4709-a873-2a94e08bdc22 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:08.561776 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7ae35d57-596b-4709-a873-2a94e08bdc22 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:08.562955 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7ae35d57-596b-4709-a873-2a94e08bdc22 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1809 microversion: 2.20 time: 0.290229 May 23 17:21:08.563529 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 222/456] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:21:08 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1809 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:21:08.947440 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c60a2ef3-e093-4607-9ace-fd5411431a6a tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-197333049"}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:21:08.948074 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c60a2ef3-e093-4607-9ace-fd5411431a6a tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:08.954447 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c60a2ef3-e093-4607-9ace-fd5411431a6a tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:08.954897 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c60a2ef3-e093-4607-9ace-fd5411431a6a tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:08.955668 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c60a2ef3-e093-4607-9ace-fd5411431a6a tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:08.956103 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c60a2ef3-e093-4607-9ace-fd5411431a6a tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:09.101951 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.network.security_group_api [None req-c60a2ef3-e093-4607-9ace-fd5411431a6a tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Adding security group 76fabacc-43ab-483b-a0c9-6074c11f5723 to port b64de995-4ddd-4471-a42a-480203d490ce May 23 17:21:09.522177 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c60a2ef3-e093-4607-9ace-fd5411431a6a tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "POST /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2/action" status: 202 len: 0 microversion: 2.1 time: 0.579939 May 23 17:21:09.526965 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 235/457] 10.222.0.46 () {60 vars in 1277 bytes} [Mon May 23 17:21:08 2022] POST /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2/action => generated 0 bytes in 586 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 17:21:09.533095 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9e7b8c5a-953f-470c-ade5-23d5bff689b1 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:09.533651 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-6488de55-9b63-439d-8004-af0b17b6be3c req-9a4036b8-9c8d-487e-8aaf-f380225059ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c6c849e-492f-4bd4-91d8-f1622420a3d2", "tag": "b64de995-4ddd-4471-a42a-480203d490ce"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:21:09.534513 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9e7b8c5a-953f-470c-ade5-23d5bff689b1 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:09.542222 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9e7b8c5a-953f-470c-ade5-23d5bff689b1 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:09.542820 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9e7b8c5a-953f-470c-ade5-23d5bff689b1 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:09.543663 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9e7b8c5a-953f-470c-ade5-23d5bff689b1 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:09.544367 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9e7b8c5a-953f-470c-ade5-23d5bff689b1 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:09.544532 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-6488de55-9b63-439d-8004-af0b17b6be3c req-9a4036b8-9c8d-487e-8aaf-f380225059ea service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:09.545034 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-6488de55-9b63-439d-8004-af0b17b6be3c req-9a4036b8-9c8d-487e-8aaf-f380225059ea service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:09.564564 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-6488de55-9b63-439d-8004-af0b17b6be3c req-9a4036b8-9c8d-487e-8aaf-f380225059ea service nova] Creating event network-changed:b64de995-4ddd-4471-a42a-480203d490ce for instance 7c6c849e-492f-4bd4-91d8-f1622420a3d2 on hv-cinder-84299 May 23 17:21:09.570088 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-6488de55-9b63-439d-8004-af0b17b6be3c req-9a4036b8-9c8d-487e-8aaf-f380225059ea service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041395 May 23 17:21:09.570905 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 236/458] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:21:09.583499 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-3ed7c5ad-4844-4674-833f-a8c0edc07245 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:09.584353 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-3ed7c5ad-4844-4674-833f-a8c0edc07245 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:09.592060 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3ed7c5ad-4844-4674-833f-a8c0edc07245 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:09.592528 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3ed7c5ad-4844-4674-833f-a8c0edc07245 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:09.593343 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3ed7c5ad-4844-4674-833f-a8c0edc07245 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:09.594018 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3ed7c5ad-4844-4674-833f-a8c0edc07245 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:09.808687 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-3ed7c5ad-4844-4674-833f-a8c0edc07245 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:09.811576 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9e7b8c5a-953f-470c-ade5-23d5bff689b1 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:09.818470 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-3ed7c5ad-4844-4674-833f-a8c0edc07245 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:09.819960 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9e7b8c5a-953f-470c-ade5-23d5bff689b1 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1760 microversion: 2.1 time: 0.291758 May 23 17:21:09.820373 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-3ed7c5ad-4844-4674-833f-a8c0edc07245 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:09.820707 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 223/459] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:21:09 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1760 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:21:09.821716 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-3ed7c5ad-4844-4674-833f-a8c0edc07245 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1809 microversion: 2.20 time: 0.243533 May 23 17:21:09.828287 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 237/460] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:21:09 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1809 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:21:10.842327 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f90c0cfd-408d-426f-8137-d1aedc78ba1a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:10.842909 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f90c0cfd-408d-426f-8137-d1aedc78ba1a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:10.850045 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f90c0cfd-408d-426f-8137-d1aedc78ba1a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:10.850517 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f90c0cfd-408d-426f-8137-d1aedc78ba1a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:10.851265 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f90c0cfd-408d-426f-8137-d1aedc78ba1a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:10.852267 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f90c0cfd-408d-426f-8137-d1aedc78ba1a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:11.280490 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f90c0cfd-408d-426f-8137-d1aedc78ba1a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:11.291928 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f90c0cfd-408d-426f-8137-d1aedc78ba1a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:11.293617 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f90c0cfd-408d-426f-8137-d1aedc78ba1a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:11.294834 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f90c0cfd-408d-426f-8137-d1aedc78ba1a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1809 microversion: 2.20 time: 0.458326 May 23 17:21:11.295373 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 224/461] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:21:10 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1809 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:21:12.316299 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-96a30277-b68c-476e-8be6-4ea8a97536be tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:12.317540 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-96a30277-b68c-476e-8be6-4ea8a97536be tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:12.326515 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-96a30277-b68c-476e-8be6-4ea8a97536be tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:12.326967 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-96a30277-b68c-476e-8be6-4ea8a97536be tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:12.327734 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-96a30277-b68c-476e-8be6-4ea8a97536be tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:12.328178 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-96a30277-b68c-476e-8be6-4ea8a97536be tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:12.472317 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-96a30277-b68c-476e-8be6-4ea8a97536be tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:12.481710 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-96a30277-b68c-476e-8be6-4ea8a97536be tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:12.483323 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-96a30277-b68c-476e-8be6-4ea8a97536be tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:12.484486 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-96a30277-b68c-476e-8be6-4ea8a97536be tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1809 microversion: 2.20 time: 0.174682 May 23 17:21:12.485082 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 238/462] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:21:12 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:21:13.503405 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7031f6b1-49e2-4cb3-aaf7-72a2dd81cf5f tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:13.504017 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7031f6b1-49e2-4cb3-aaf7-72a2dd81cf5f tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:13.510971 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7031f6b1-49e2-4cb3-aaf7-72a2dd81cf5f tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:13.511435 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7031f6b1-49e2-4cb3-aaf7-72a2dd81cf5f tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:13.512260 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7031f6b1-49e2-4cb3-aaf7-72a2dd81cf5f tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:13.514240 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7031f6b1-49e2-4cb3-aaf7-72a2dd81cf5f tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:13.649307 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7031f6b1-49e2-4cb3-aaf7-72a2dd81cf5f tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:13.657781 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7031f6b1-49e2-4cb3-aaf7-72a2dd81cf5f tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:13.659281 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7031f6b1-49e2-4cb3-aaf7-72a2dd81cf5f tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:13.660473 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7031f6b1-49e2-4cb3-aaf7-72a2dd81cf5f tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1809 microversion: 2.20 time: 0.161275 May 23 17:21:13.664837 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 225/463] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:21:13 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:21:14.547436 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 17:21:14.548173 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Mon May 23 17:21:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 17:21:14.679340 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-06e93a23-b484-40a3-befa-311411fe1aed tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:14.679958 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-06e93a23-b484-40a3-befa-311411fe1aed tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:14.686594 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-06e93a23-b484-40a3-befa-311411fe1aed tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:14.687044 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-06e93a23-b484-40a3-befa-311411fe1aed tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:14.687855 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-06e93a23-b484-40a3-befa-311411fe1aed tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:14.688291 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-06e93a23-b484-40a3-befa-311411fe1aed tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:14.810744 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-270c4c24-ba66-49b0-bcdf-22b680c7dc91 req-5565cbc3-0c71-47e8-bef1-8d4633e50d76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4273c3a-0aba-4184-b088-2feaea1b1091", "name": "network-vif-plugged", "status": "completed", "tag": "0c234a65-eea7-4bdf-ac00-34147e4abec0"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:21:14.822449 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-270c4c24-ba66-49b0-bcdf-22b680c7dc91 req-5565cbc3-0c71-47e8-bef1-8d4633e50d76 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:14.828626 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-270c4c24-ba66-49b0-bcdf-22b680c7dc91 req-5565cbc3-0c71-47e8-bef1-8d4633e50d76 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:14.839744 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-06e93a23-b484-40a3-befa-311411fe1aed tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:14.850462 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-270c4c24-ba66-49b0-bcdf-22b680c7dc91 req-5565cbc3-0c71-47e8-bef1-8d4633e50d76 service nova] Creating event network-vif-plugged:0c234a65-eea7-4bdf-ac00-34147e4abec0 for instance f4273c3a-0aba-4184-b088-2feaea1b1091 on hv-cinder-84299 May 23 17:21:14.851273 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-06e93a23-b484-40a3-befa-311411fe1aed tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:14.853084 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-06e93a23-b484-40a3-befa-311411fe1aed tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:14.854347 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-06e93a23-b484-40a3-befa-311411fe1aed tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1809 microversion: 2.20 time: 0.178942 May 23 17:21:14.855275 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 239/464] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:21:14 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:21:14.857575 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-270c4c24-ba66-49b0-bcdf-22b680c7dc91 req-5565cbc3-0c71-47e8-bef1-8d4633e50d76 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051054 May 23 17:21:14.858194 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 226/465] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 17:21:15.874084 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e19bc49f-ce93-49e1-80b5-e150c5482417 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:15.874592 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-e19bc49f-ce93-49e1-80b5-e150c5482417 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:15.881632 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e19bc49f-ce93-49e1-80b5-e150c5482417 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:15.882066 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e19bc49f-ce93-49e1-80b5-e150c5482417 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:15.882865 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e19bc49f-ce93-49e1-80b5-e150c5482417 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:15.883304 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e19bc49f-ce93-49e1-80b5-e150c5482417 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:16.014534 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e19bc49f-ce93-49e1-80b5-e150c5482417 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:16.023967 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e19bc49f-ce93-49e1-80b5-e150c5482417 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:16.025962 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e19bc49f-ce93-49e1-80b5-e150c5482417 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:16.027144 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-e19bc49f-ce93-49e1-80b5-e150c5482417 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1809 microversion: 2.20 time: 0.157969 May 23 17:21:16.027907 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 240/466] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:21:15 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:21:17.047274 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-08de8818-3d44-4356-9176-4e6101532716 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:17.048026 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-08de8818-3d44-4356-9176-4e6101532716 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:17.055051 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-08de8818-3d44-4356-9176-4e6101532716 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:17.055537 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-08de8818-3d44-4356-9176-4e6101532716 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:17.056373 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-08de8818-3d44-4356-9176-4e6101532716 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:17.056995 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-08de8818-3d44-4356-9176-4e6101532716 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:17.195097 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-08de8818-3d44-4356-9176-4e6101532716 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:17.207545 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-08de8818-3d44-4356-9176-4e6101532716 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:17.209968 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-08de8818-3d44-4356-9176-4e6101532716 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:17.211945 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-08de8818-3d44-4356-9176-4e6101532716 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1809 microversion: 2.20 time: 0.169227 May 23 17:21:17.212498 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 227/467] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:21:17 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:21:18.240011 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-1105492e-8173-4aa5-8d8e-2ee669312096 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:18.240996 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-1105492e-8173-4aa5-8d8e-2ee669312096 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:18.252772 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1105492e-8173-4aa5-8d8e-2ee669312096 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:18.253642 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1105492e-8173-4aa5-8d8e-2ee669312096 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:18.254876 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1105492e-8173-4aa5-8d8e-2ee669312096 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:18.255599 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1105492e-8173-4aa5-8d8e-2ee669312096 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:18.392249 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-1105492e-8173-4aa5-8d8e-2ee669312096 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:18.405930 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-1105492e-8173-4aa5-8d8e-2ee669312096 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:18.408271 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-1105492e-8173-4aa5-8d8e-2ee669312096 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:18.410102 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-1105492e-8173-4aa5-8d8e-2ee669312096 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1809 microversion: 2.20 time: 0.176393 May 23 17:21:18.410902 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 241/468] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:21:18 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:21:19.432723 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6cbce15c-1400-46c9-b0f2-c56fd31801b4 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:19.433426 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6cbce15c-1400-46c9-b0f2-c56fd31801b4 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:19.440706 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6cbce15c-1400-46c9-b0f2-c56fd31801b4 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:19.441207 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6cbce15c-1400-46c9-b0f2-c56fd31801b4 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:19.442048 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6cbce15c-1400-46c9-b0f2-c56fd31801b4 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:19.442530 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6cbce15c-1400-46c9-b0f2-c56fd31801b4 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:19.582592 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6cbce15c-1400-46c9-b0f2-c56fd31801b4 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:19.591500 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6cbce15c-1400-46c9-b0f2-c56fd31801b4 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:19.593063 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6cbce15c-1400-46c9-b0f2-c56fd31801b4 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:19.594226 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6cbce15c-1400-46c9-b0f2-c56fd31801b4 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1809 microversion: 2.20 time: 0.167925 May 23 17:21:19.594836 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 228/469] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:21:19 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:21:20.612850 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-eee641c7-8062-4269-96b2-fc472f5074a2 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:20.613311 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-eee641c7-8062-4269-96b2-fc472f5074a2 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:20.620288 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-eee641c7-8062-4269-96b2-fc472f5074a2 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:20.620775 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-eee641c7-8062-4269-96b2-fc472f5074a2 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:20.621550 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-eee641c7-8062-4269-96b2-fc472f5074a2 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:20.621984 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-eee641c7-8062-4269-96b2-fc472f5074a2 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:20.752432 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-eee641c7-8062-4269-96b2-fc472f5074a2 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:20.761179 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-eee641c7-8062-4269-96b2-fc472f5074a2 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:20.763019 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-eee641c7-8062-4269-96b2-fc472f5074a2 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:20.764189 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-eee641c7-8062-4269-96b2-fc472f5074a2 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1809 microversion: 2.20 time: 0.155546 May 23 17:21:20.764750 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 242/470] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:21:20 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:21:21.787301 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-86dee614-2a8f-4f7b-b2b1-1da425efc9ef tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:21.788254 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-86dee614-2a8f-4f7b-b2b1-1da425efc9ef tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:21.799913 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-86dee614-2a8f-4f7b-b2b1-1da425efc9ef tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:21.800759 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-86dee614-2a8f-4f7b-b2b1-1da425efc9ef tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:21.802042 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-86dee614-2a8f-4f7b-b2b1-1da425efc9ef tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:21.802767 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-86dee614-2a8f-4f7b-b2b1-1da425efc9ef tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:21.935601 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-86dee614-2a8f-4f7b-b2b1-1da425efc9ef tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:21.944202 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-86dee614-2a8f-4f7b-b2b1-1da425efc9ef tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:21.945741 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-86dee614-2a8f-4f7b-b2b1-1da425efc9ef tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:21.946900 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-86dee614-2a8f-4f7b-b2b1-1da425efc9ef tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1796 microversion: 2.20 time: 0.166201 May 23 17:21:21.947485 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 229/471] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:21:21 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1796 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:21:34.143731 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-4255aee9-3980-4878-9a7c-4c649b692c3e tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:34.144258 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-4255aee9-3980-4878-9a7c-4c649b692c3e tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 6664de84-4c36-42da-9577-594b6bc73fec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:34.146926 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=31 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:21:34.147581 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:21:34.153806 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4255aee9-3980-4878-9a7c-4c649b692c3e tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:34.154275 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4255aee9-3980-4878-9a7c-4c649b692c3e tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:34.155372 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4255aee9-3980-4878-9a7c-4c649b692c3e tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:34.155822 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4255aee9-3980-4878-9a7c-4c649b692c3e tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:34.283262 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.objects.instance [None req-4255aee9-3980-4878-9a7c-4c649b692c3e tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lazy-loading 'services' on Instance uuid 6664de84-4c36-42da-9577-594b6bc73fec {{(pid=117910) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 17:21:34.406187 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-4255aee9-3980-4878-9a7c-4c649b692c3e tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec/os-volume_attachments/198e0794-f4be-42db-80e7-a52105d3f13e" status: 202 len: 0 microversion: 2.1 time: 0.266217 May 23 17:21:34.407274 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 243/472] 10.222.0.46 () {58 vars in 1415 bytes} [Mon May 23 17:21:34 2022] DELETE /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec/os-volume_attachments/198e0794-f4be-42db-80e7-a52105d3f13e => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 17:21:35.545062 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-750ef385-c97b-4f5a-a65b-3de56e75b2d5 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:35.545600 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-750ef385-c97b-4f5a-a65b-3de56e75b2d5 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 6664de84-4c36-42da-9577-594b6bc73fec] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:35.548122 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=25 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:21:35.549067 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=83 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:21:35.554973 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-750ef385-c97b-4f5a-a65b-3de56e75b2d5 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:35.555429 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-750ef385-c97b-4f5a-a65b-3de56e75b2d5 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:35.556183 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-750ef385-c97b-4f5a-a65b-3de56e75b2d5 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:35.556625 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-750ef385-c97b-4f5a-a65b-3de56e75b2d5 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:35.581825 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-750ef385-c97b-4f5a-a65b-3de56e75b2d5 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 6664de84-4c36-42da-9577-594b6bc73fec] Going to try to terminate instance {{(pid=117909) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 17:21:35.661107 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-750ef385-c97b-4f5a-a65b-3de56e75b2d5 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec" status: 204 len: 0 microversion: 2.1 time: 0.119657 May 23 17:21:35.661819 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 230/473] 10.222.0.46 () {58 vars in 1238 bytes} [Mon May 23 17:21:35 2022] DELETE /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 17:21:35.673509 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-80bca887-37f8-4ce0-8fdf-bfa80617012e tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:35.674210 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-80bca887-37f8-4ce0-8fdf-bfa80617012e tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 6664de84-4c36-42da-9577-594b6bc73fec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:35.680908 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-80bca887-37f8-4ce0-8fdf-bfa80617012e tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:35.681370 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-80bca887-37f8-4ce0-8fdf-bfa80617012e tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:35.682140 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-80bca887-37f8-4ce0-8fdf-bfa80617012e tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:35.682579 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-80bca887-37f8-4ce0-8fdf-bfa80617012e tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:35.830606 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-80bca887-37f8-4ce0-8fdf-bfa80617012e tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:35.838532 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-80bca887-37f8-4ce0-8fdf-bfa80617012e tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec" status: 200 len: 1514 microversion: 2.1 time: 0.170225 May 23 17:21:35.839081 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 244/474] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:21:35 2022] GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:21:36.856080 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e9aebfcb-4005-4d85-bbe1-67268ecf4991 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:36.856801 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e9aebfcb-4005-4d85-bbe1-67268ecf4991 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 6664de84-4c36-42da-9577-594b6bc73fec] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:36.864100 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e9aebfcb-4005-4d85-bbe1-67268ecf4991 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:36.864548 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e9aebfcb-4005-4d85-bbe1-67268ecf4991 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:36.865389 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e9aebfcb-4005-4d85-bbe1-67268ecf4991 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:36.865791 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e9aebfcb-4005-4d85-bbe1-67268ecf4991 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:36.996781 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e9aebfcb-4005-4d85-bbe1-67268ecf4991 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:37.004750 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e9aebfcb-4005-4d85-bbe1-67268ecf4991 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec" status: 200 len: 1514 microversion: 2.1 time: 0.152956 May 23 17:21:37.005343 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 231/475] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:21:36 2022] GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:21:37.924246 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-274a5647-0a81-46ad-94ce-c40debb20ff7 req-8b5a097e-9df7-4e80-97db-0840c8e96b52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6664de84-4c36-42da-9577-594b6bc73fec", "name": "network-vif-deleted", "tag": "6e8a38a1-d3f7-4b87-84d5-ede2178f2cd2"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:21:37.933137 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-274a5647-0a81-46ad-94ce-c40debb20ff7 req-8b5a097e-9df7-4e80-97db-0840c8e96b52 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:37.933645 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-274a5647-0a81-46ad-94ce-c40debb20ff7 req-8b5a097e-9df7-4e80-97db-0840c8e96b52 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:37.945240 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-274a5647-0a81-46ad-94ce-c40debb20ff7 req-8b5a097e-9df7-4e80-97db-0840c8e96b52 service nova] Creating event network-vif-deleted:6e8a38a1-d3f7-4b87-84d5-ede2178f2cd2 for instance 6664de84-4c36-42da-9577-594b6bc73fec on hv-cinder-84299 May 23 17:21:37.950551 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-274a5647-0a81-46ad-94ce-c40debb20ff7 req-8b5a097e-9df7-4e80-97db-0840c8e96b52 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030010 May 23 17:21:37.951446 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 245/476] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:21:38.022542 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c5f350e6-b15c-4129-94eb-d037a6be342f tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:38.023153 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c5f350e6-b15c-4129-94eb-d037a6be342f tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 6664de84-4c36-42da-9577-594b6bc73fec] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:38.030803 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c5f350e6-b15c-4129-94eb-d037a6be342f tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:38.031402 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c5f350e6-b15c-4129-94eb-d037a6be342f tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:38.032530 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c5f350e6-b15c-4129-94eb-d037a6be342f tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:38.033331 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c5f350e6-b15c-4129-94eb-d037a6be342f tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:38.067797 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c5f350e6-b15c-4129-94eb-d037a6be342f tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:38.068167 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c5f350e6-b15c-4129-94eb-d037a6be342f tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:38.068649 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.objects.instance [None req-c5f350e6-b15c-4129-94eb-d037a6be342f tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lazy-loading 'fault' on Instance uuid 6664de84-4c36-42da-9577-594b6bc73fec {{(pid=117909) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 17:21:38.113160 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c5f350e6-b15c-4129-94eb-d037a6be342f tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:38.121102 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c5f350e6-b15c-4129-94eb-d037a6be342f tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec" status: 200 len: 1309 microversion: 2.1 time: 0.102585 May 23 17:21:38.121658 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 232/477] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:21:38 2022] GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec => generated 1309 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:21:39.143009 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2efed6ef-684d-4913-ae23-fbf0b46fe48e tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:39.143659 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2efed6ef-684d-4913-ae23-fbf0b46fe48e tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 6664de84-4c36-42da-9577-594b6bc73fec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:39.150510 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2efed6ef-684d-4913-ae23-fbf0b46fe48e tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:39.150956 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2efed6ef-684d-4913-ae23-fbf0b46fe48e tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:39.151715 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2efed6ef-684d-4913-ae23-fbf0b46fe48e tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:39.152143 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2efed6ef-684d-4913-ae23-fbf0b46fe48e tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:39.166235 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-2efed6ef-684d-4913-ae23-fbf0b46fe48e tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] HTTP exception thrown: Instance 6664de84-4c36-42da-9577-594b6bc73fec could not be found. May 23 17:21:39.167829 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2efed6ef-684d-4913-ae23-fbf0b46fe48e tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Request method failure captured: May 23 17:21:39.167829 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: request: GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec HTTP/1.1 May 23 17:21:39.167829 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept: application/json May 23 17:21:39.167829 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity May 23 17:21:39.167829 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Connection: close May 23 17:21:39.167829 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Length: 0 May 23 17:21:39.167829 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Type: application/json May 23 17:21:39.167829 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Host: 10.222.0.46 May 23 17:21:39.167829 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None May 23 17:21:39.167829 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.9 May 23 17:21:39.167829 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABii8I4LZLM5U8o-SdUCjW7spYaCQ4ouMICHcauAIeSCyYU2ZlWbuLtmTC7QcvOLcf_v-jCcJnbNUXWjI4wvExOfmnZMnPuTtGygpwuz9stNBGMJjsiR1p3uaIv7gNaEb6CJWurhJaekMcnSZAvYpj00ZTtdYJy9qH81FWkKTZT5OWOdbY May 23 17:21:39.167829 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Id: None May 23 17:21:39.167829 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Name: None May 23 17:21:39.167829 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed May 23 17:21:39.167829 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True May 23 17:21:39.167829 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default May 23 17:21:39.167829 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default May 23 17:21:39.167829 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Id: 19de3d45e12e40a9949c91c7f1cd4fe3 May 23 17:21:39.167829 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1736113026 May 23 17:21:39.167829 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Role: reader,member May 23 17:21:39.167829 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Roles: reader,member May 23 17:21:39.169347 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/19de3d45e12e40a9949c91c7f1cd4fe3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/19de3d45e12e40a9949c91c7f1cd4fe3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/19de3d45e12e40a9949c91c7f1cd4fe3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_19de3d45e12e40a9949c91c7f1cd4fe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:21:39.169347 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-VolumesSnapshotTestJSON-1736113026 May 23 17:21:39.169347 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 19de3d45e12e40a9949c91c7f1cd4fe3 May 23 17:21:39.169347 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1736113026 May 23 17:21:39.169347 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User: tempest-VolumesSnapshotTestJSON-1736113026-project May 23 17:21:39.169347 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default May 23 17:21:39.169347 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default May 23 17:21:39.169347 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Id: 25c25a40827e4737a7ae823dee8615be May 23 17:21:39.169347 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-VolumesSnapshotTestJSON-1736113026-project May 23 17:21:39.169347 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: method: > May 23 17:21:39.169347 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: exception: Instance 6664de84-4c36-42da-9577-594b6bc73fec could not be found. May 23 17:21:39.169347 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: action_args: {'id': '6664de84-4c36-42da-9577-594b6bc73fec'} May 23 17:21:39.170198 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:21:39.170198 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:21:39.170198 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:21:39.170198 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:21:39.170198 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:21:39.170198 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:21:39.170198 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:21:39.170198 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:21:39.170198 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:21:39.170198 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:21:39.170198 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6664de84-4c36-42da-9577-594b6bc73fec could not be found. May 23 17:21:39.170198 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:21:39.170198 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:21:39.170198 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:21:39.170198 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:21:39.170198 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:21:39.170198 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:21:39.170198 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:21:39.170198 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:21:39.170198 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:21:39.171800 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:21:39.171800 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 17:21:39.171800 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 17:21:39.171800 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:21:39.171800 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:21:39.171800 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:21:39.171800 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:21:39.171800 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6664de84-4c36-42da-9577-594b6bc73fec could not be found. May 23 17:21:39.171800 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:21:39.171800 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:21:39.171800 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:21:39.171800 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:21:39.171800 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:21:39.171800 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:21:39.171800 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:21:39.171800 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:21:39.171800 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6664de84-4c36-42da-9577-594b6bc73fec could not be found. May 23 17:21:39.171800 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:21:39.173478 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2efed6ef-684d-4913-ae23-fbf0b46fe48e tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Returning 404 to user: Instance 6664de84-4c36-42da-9577-594b6bc73fec could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:21:39.173478 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2efed6ef-684d-4913-ae23-fbf0b46fe48e tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec" status: 404 len: 111 microversion: 2.1 time: 0.034261 May 23 17:21:39.173478 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 246/478] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:21:39 2022] GET /compute/v2.1/servers/6664de84-4c36-42da-9577-594b6bc73fec => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:21:47.060006 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-417525a6-9c15-4abc-908e-46c933dff550 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1785843201", "imageRef": "99870172-61a4-4218-9407-6a6da3fb5c83", "flavorRef": "452", "networks": [{"uuid": "4dd05859-d197-4158-b1d0-4b2dca1b49ac"}]}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:21:47.111176 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.network.neutron [None req-417525a6-9c15-4abc-908e-46c933dff550 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] validate_networks() for [('4dd05859-d197-4158-b1d0-4b2dca1b49ac', None, None, None, None, None)] {{(pid=117909) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 17:21:47.580922 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-417525a6-9c15-4abc-908e-46c933dff550 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Flavor limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 17:21:47.581539 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-417525a6-9c15-4abc-908e-46c933dff550 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Image limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 17:21:47.582341 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-417525a6-9c15-4abc-908e-46c933dff550 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Flavor pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 17:21:47.582998 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-417525a6-9c15-4abc-908e-46c933dff550 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Image pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 17:21:47.583570 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-417525a6-9c15-4abc-908e-46c933dff550 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 17:21:47.598763 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-417525a6-9c15-4abc-908e-46c933dff550 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:47.599539 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-417525a6-9c15-4abc-908e-46c933dff550 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:47.600337 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-417525a6-9c15-4abc-908e-46c933dff550 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:47.600814 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-417525a6-9c15-4abc-908e-46c933dff550 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:47.617456 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-417525a6-9c15-4abc-908e-46c933dff550 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Getting quotas for project 19de3d45e12e40a9949c91c7f1cd4fe3. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 17:21:47.621343 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-417525a6-9c15-4abc-908e-46c933dff550 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Getting quotas for user 25c25a40827e4737a7ae823dee8615be and project 19de3d45e12e40a9949c91c7f1cd4fe3. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 17:21:47.631803 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-417525a6-9c15-4abc-908e-46c933dff550 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Going to run 1 instances... {{(pid=117909) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 17:21:47.634094 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-417525a6-9c15-4abc-908e-46c933dff550 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 9ed3837e-0541-485a-9795-7aabaddcaec0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99870172-61a4-4218-9407-6a6da3fb5c83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 17:21:47.682170 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-417525a6-9c15-4abc-908e-46c933dff550 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.626172 May 23 17:21:47.682817 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 233/479] 10.222.0.46 () {60 vars in 1146 bytes} [Mon May 23 17:21:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 17:21:47.693050 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-5d741d8d-f2cd-4f1f-a4f0-4277e1132b2d tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:47.693882 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-5d741d8d-f2cd-4f1f-a4f0-4277e1132b2d tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 9ed3837e-0541-485a-9795-7aabaddcaec0] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:47.746750 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-5d741d8d-f2cd-4f1f-a4f0-4277e1132b2d tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:47.753859 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-5d741d8d-f2cd-4f1f-a4f0-4277e1132b2d tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/9ed3837e-0541-485a-9795-7aabaddcaec0" status: 200 len: 1219 microversion: 2.1 time: 0.064827 May 23 17:21:47.754427 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 247/480] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:21:47 2022] GET /compute/v2.1/servers/9ed3837e-0541-485a-9795-7aabaddcaec0 => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:21:48.040985 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-be188b80-2b96-4f66-bced-eb77e85aec50 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82bf1310-3505-4c9d-b6c9-3e95f8371e04"}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:21:48.042125 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-be188b80-2b96-4f66-bced-eb77e85aec50 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:48.049632 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-be188b80-2b96-4f66-bced-eb77e85aec50 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:48.049980 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-be188b80-2b96-4f66-bced-eb77e85aec50 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:48.050738 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-be188b80-2b96-4f66-bced-eb77e85aec50 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:48.051169 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-be188b80-2b96-4f66-bced-eb77e85aec50 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:48.371150 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-be188b80-2b96-4f66-bced-eb77e85aec50 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "POST /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.334011 May 23 17:21:48.372506 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 234/481] 10.222.0.46 () {60 vars in 1322 bytes} [Mon May 23 17:21:48 2022] POST /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165/os-volume_attachments => generated 194 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:21:48.775623 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c45e55a3-cbf7-4bf5-b410-01fefe9d71dd tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:48.776624 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c45e55a3-cbf7-4bf5-b410-01fefe9d71dd tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 9ed3837e-0541-485a-9795-7aabaddcaec0] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:48.789092 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c45e55a3-cbf7-4bf5-b410-01fefe9d71dd tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:48.789881 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c45e55a3-cbf7-4bf5-b410-01fefe9d71dd tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:48.791172 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c45e55a3-cbf7-4bf5-b410-01fefe9d71dd tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:48.791940 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c45e55a3-cbf7-4bf5-b410-01fefe9d71dd tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:48.868410 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-c45e55a3-cbf7-4bf5-b410-01fefe9d71dd tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:48.877599 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c45e55a3-cbf7-4bf5-b410-01fefe9d71dd tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/9ed3837e-0541-485a-9795-7aabaddcaec0" status: 200 len: 1271 microversion: 2.1 time: 0.108688 May 23 17:21:48.880712 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 248/482] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:21:48 2022] GET /compute/v2.1/servers/9ed3837e-0541-485a-9795-7aabaddcaec0 => generated 1271 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:21:49.902629 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6f523ebf-10d9-44dc-b179-11adf1763be5 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:49.903441 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6f523ebf-10d9-44dc-b179-11adf1763be5 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 9ed3837e-0541-485a-9795-7aabaddcaec0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:49.913217 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6f523ebf-10d9-44dc-b179-11adf1763be5 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:49.913741 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6f523ebf-10d9-44dc-b179-11adf1763be5 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:49.914520 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6f523ebf-10d9-44dc-b179-11adf1763be5 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:49.914960 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6f523ebf-10d9-44dc-b179-11adf1763be5 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:50.132630 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6f523ebf-10d9-44dc-b179-11adf1763be5 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:50.142511 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6f523ebf-10d9-44dc-b179-11adf1763be5 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/9ed3837e-0541-485a-9795-7aabaddcaec0" status: 200 len: 1319 microversion: 2.1 time: 0.247064 May 23 17:21:50.143112 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 235/483] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:21:49 2022] GET /compute/v2.1/servers/9ed3837e-0541-485a-9795-7aabaddcaec0 => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:21:50.355313 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-ef20893a-c124-4e5a-85ba-20355d696216 req-e360e91b-5855-4af2-a436-05b18e02ca1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ed3837e-0541-485a-9795-7aabaddcaec0", "tag": "242c4270-3339-4f03-8f19-49fbcc9ed6f4"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:21:50.365496 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-ef20893a-c124-4e5a-85ba-20355d696216 req-e360e91b-5855-4af2-a436-05b18e02ca1f service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:50.366181 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-ef20893a-c124-4e5a-85ba-20355d696216 req-e360e91b-5855-4af2-a436-05b18e02ca1f service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:50.378830 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-ef20893a-c124-4e5a-85ba-20355d696216 req-e360e91b-5855-4af2-a436-05b18e02ca1f service nova] Creating event network-changed:242c4270-3339-4f03-8f19-49fbcc9ed6f4 for instance 9ed3837e-0541-485a-9795-7aabaddcaec0 on hv-cinder-84299 May 23 17:21:50.383896 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-ef20893a-c124-4e5a-85ba-20355d696216 req-e360e91b-5855-4af2-a436-05b18e02ca1f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032278 May 23 17:21:50.384834 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 249/484] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:21:51.163904 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-744efd9d-c03d-4398-941d-1535f3a861c5 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:51.164977 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-744efd9d-c03d-4398-941d-1535f3a861c5 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 9ed3837e-0541-485a-9795-7aabaddcaec0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:51.176070 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-744efd9d-c03d-4398-941d-1535f3a861c5 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:51.176877 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-744efd9d-c03d-4398-941d-1535f3a861c5 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:51.177985 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-744efd9d-c03d-4398-941d-1535f3a861c5 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:51.178419 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-744efd9d-c03d-4398-941d-1535f3a861c5 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:51.318952 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-744efd9d-c03d-4398-941d-1535f3a861c5 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:51.326785 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-744efd9d-c03d-4398-941d-1535f3a861c5 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/9ed3837e-0541-485a-9795-7aabaddcaec0" status: 200 len: 1319 microversion: 2.1 time: 0.169434 May 23 17:21:51.327331 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 236/485] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:21:51 2022] GET /compute/v2.1/servers/9ed3837e-0541-485a-9795-7aabaddcaec0 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:21:52.348044 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-57414068-1e7e-415a-94f2-b3a6972f4a8d tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:52.349035 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-57414068-1e7e-415a-94f2-b3a6972f4a8d tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 9ed3837e-0541-485a-9795-7aabaddcaec0] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:52.358660 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-57414068-1e7e-415a-94f2-b3a6972f4a8d tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:52.359332 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-57414068-1e7e-415a-94f2-b3a6972f4a8d tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:52.360572 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-57414068-1e7e-415a-94f2-b3a6972f4a8d tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:52.361280 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-57414068-1e7e-415a-94f2-b3a6972f4a8d tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:52.503040 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-57414068-1e7e-415a-94f2-b3a6972f4a8d tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:52.514684 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-57414068-1e7e-415a-94f2-b3a6972f4a8d tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/9ed3837e-0541-485a-9795-7aabaddcaec0" status: 200 len: 1319 microversion: 2.1 time: 0.173792 May 23 17:21:52.515447 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 250/486] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:21:52 2022] GET /compute/v2.1/servers/9ed3837e-0541-485a-9795-7aabaddcaec0 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:21:52.646838 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-35383da5-f57f-4c4a-9648-2b96ddf00ce5 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:21:52.647848 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-35383da5-f57f-4c4a-9648-2b96ddf00ce5 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:52.654895 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-35383da5-f57f-4c4a-9648-2b96ddf00ce5 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:52.655342 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-35383da5-f57f-4c4a-9648-2b96ddf00ce5 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:52.656103 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-35383da5-f57f-4c4a-9648-2b96ddf00ce5 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:52.656527 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-35383da5-f57f-4c4a-9648-2b96ddf00ce5 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:52.733745 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-35383da5-f57f-4c4a-9648-2b96ddf00ce5 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "POST /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2/action" status: 202 len: 0 microversion: 2.1 time: 0.091332 May 23 17:21:52.734390 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 237/487] 10.222.0.46 () {60 vars in 1277 bytes} [Mon May 23 17:21:52 2022] POST /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 17:21:52.742827 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e2196e05-fb20-4dcf-b87f-97aca24f5559 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:52.743436 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-e2196e05-fb20-4dcf-b87f-97aca24f5559 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:52.749856 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e2196e05-fb20-4dcf-b87f-97aca24f5559 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:52.750342 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e2196e05-fb20-4dcf-b87f-97aca24f5559 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:52.751090 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e2196e05-fb20-4dcf-b87f-97aca24f5559 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:52.751522 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e2196e05-fb20-4dcf-b87f-97aca24f5559 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:52.989912 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e2196e05-fb20-4dcf-b87f-97aca24f5559 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:53.000342 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-e2196e05-fb20-4dcf-b87f-97aca24f5559 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1752 microversion: 2.1 time: 0.261391 May 23 17:21:53.000949 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 251/488] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:21:52 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1752 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:21:53.532818 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-acac844e-a8b4-4694-9ed8-22ba99626365 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:53.533632 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-acac844e-a8b4-4694-9ed8-22ba99626365 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 9ed3837e-0541-485a-9795-7aabaddcaec0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:53.541269 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-acac844e-a8b4-4694-9ed8-22ba99626365 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:53.541794 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-acac844e-a8b4-4694-9ed8-22ba99626365 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:53.542653 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-acac844e-a8b4-4694-9ed8-22ba99626365 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:53.543180 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-acac844e-a8b4-4694-9ed8-22ba99626365 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:53.681116 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-acac844e-a8b4-4694-9ed8-22ba99626365 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:53.689320 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-acac844e-a8b4-4694-9ed8-22ba99626365 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/9ed3837e-0541-485a-9795-7aabaddcaec0" status: 200 len: 1319 microversion: 2.1 time: 0.160990 May 23 17:21:53.690100 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 238/489] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:21:53 2022] GET /compute/v2.1/servers/9ed3837e-0541-485a-9795-7aabaddcaec0 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:21:54.022530 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2637ed0c-7c37-43b1-8e8f-0bd1b2006d5d tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:54.023348 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2637ed0c-7c37-43b1-8e8f-0bd1b2006d5d tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:54.032100 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2637ed0c-7c37-43b1-8e8f-0bd1b2006d5d tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:54.032615 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2637ed0c-7c37-43b1-8e8f-0bd1b2006d5d tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:54.033613 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2637ed0c-7c37-43b1-8e8f-0bd1b2006d5d tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:54.034170 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2637ed0c-7c37-43b1-8e8f-0bd1b2006d5d tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:54.209138 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2637ed0c-7c37-43b1-8e8f-0bd1b2006d5d tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:54.217121 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2637ed0c-7c37-43b1-8e8f-0bd1b2006d5d tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1757 microversion: 2.1 time: 0.201004 May 23 17:21:54.217658 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 252/490] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:21:54 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1757 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:21:54.708579 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-04d80d02-79e5-4c61-b4b1-8cd3f1c6ea04 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:54.709442 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-04d80d02-79e5-4c61-b4b1-8cd3f1c6ea04 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 9ed3837e-0541-485a-9795-7aabaddcaec0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:54.718228 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-04d80d02-79e5-4c61-b4b1-8cd3f1c6ea04 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:54.718841 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-04d80d02-79e5-4c61-b4b1-8cd3f1c6ea04 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:54.719847 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-04d80d02-79e5-4c61-b4b1-8cd3f1c6ea04 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:54.720418 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-04d80d02-79e5-4c61-b4b1-8cd3f1c6ea04 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:54.862149 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-04d80d02-79e5-4c61-b4b1-8cd3f1c6ea04 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:54.870355 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-04d80d02-79e5-4c61-b4b1-8cd3f1c6ea04 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/9ed3837e-0541-485a-9795-7aabaddcaec0" status: 200 len: 1319 microversion: 2.1 time: 0.167063 May 23 17:21:54.870968 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 239/491] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:21:54 2022] GET /compute/v2.1/servers/9ed3837e-0541-485a-9795-7aabaddcaec0 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:21:54.980854 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-5bc396c2-a24d-418c-8188-6ddd855d54e5 req-8b493044-1a0e-43d2-a91e-f9b5cffce219 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ed3837e-0541-485a-9795-7aabaddcaec0", "name": "network-vif-plugged", "status": "completed", "tag": "242c4270-3339-4f03-8f19-49fbcc9ed6f4"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:21:54.989593 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-5bc396c2-a24d-418c-8188-6ddd855d54e5 req-8b493044-1a0e-43d2-a91e-f9b5cffce219 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:54.990074 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-5bc396c2-a24d-418c-8188-6ddd855d54e5 req-8b493044-1a0e-43d2-a91e-f9b5cffce219 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:55.002649 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-5bc396c2-a24d-418c-8188-6ddd855d54e5 req-8b493044-1a0e-43d2-a91e-f9b5cffce219 service nova] Creating event network-vif-plugged:242c4270-3339-4f03-8f19-49fbcc9ed6f4 for instance 9ed3837e-0541-485a-9795-7aabaddcaec0 on hv-cinder-84299 May 23 17:21:55.007900 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-5bc396c2-a24d-418c-8188-6ddd855d54e5 req-8b493044-1a0e-43d2-a91e-f9b5cffce219 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030739 May 23 17:21:55.008471 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 253/492] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:21:55.238937 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-92e89ae2-6dba-4678-b8c1-37e9e5beeee7 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:55.240354 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-92e89ae2-6dba-4678-b8c1-37e9e5beeee7 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:55.251739 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-92e89ae2-6dba-4678-b8c1-37e9e5beeee7 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:55.252586 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-92e89ae2-6dba-4678-b8c1-37e9e5beeee7 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:55.254387 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-92e89ae2-6dba-4678-b8c1-37e9e5beeee7 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:55.254986 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-92e89ae2-6dba-4678-b8c1-37e9e5beeee7 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:55.487995 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-92e89ae2-6dba-4678-b8c1-37e9e5beeee7 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:55.496384 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-92e89ae2-6dba-4678-b8c1-37e9e5beeee7 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1757 microversion: 2.1 time: 0.264099 May 23 17:21:55.496921 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 240/493] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:21:55 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1757 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:21:55.888589 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-cae68f0b-7ff4-4dc7-932e-6357891996cc tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:55.889293 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-cae68f0b-7ff4-4dc7-932e-6357891996cc tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 9ed3837e-0541-485a-9795-7aabaddcaec0] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:55.895658 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cae68f0b-7ff4-4dc7-932e-6357891996cc tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:55.896098 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cae68f0b-7ff4-4dc7-932e-6357891996cc tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:55.896887 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cae68f0b-7ff4-4dc7-932e-6357891996cc tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:55.897314 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cae68f0b-7ff4-4dc7-932e-6357891996cc tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:55.936056 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6de07b32-361b-435e-85da-0d781a78b5a6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:21:55.937083 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6de07b32-361b-435e-85da-0d781a78b5a6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:55.943771 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6de07b32-361b-435e-85da-0d781a78b5a6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:55.944215 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6de07b32-361b-435e-85da-0d781a78b5a6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:55.945077 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6de07b32-361b-435e-85da-0d781a78b5a6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:55.945507 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6de07b32-361b-435e-85da-0d781a78b5a6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:55.968044 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.objects.instance [None req-6de07b32-361b-435e-85da-0d781a78b5a6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lazy-loading 'flavor' on Instance uuid c26b20b6-8a97-4aa1-af83-616cc09c9165 {{(pid=117909) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 17:21:56.028055 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-cae68f0b-7ff4-4dc7-932e-6357891996cc tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:56.036815 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-cae68f0b-7ff4-4dc7-932e-6357891996cc tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/9ed3837e-0541-485a-9795-7aabaddcaec0" status: 200 len: 1319 microversion: 2.1 time: 0.152737 May 23 17:21:56.037367 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 254/494] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:21:55 2022] GET /compute/v2.1/servers/9ed3837e-0541-485a-9795-7aabaddcaec0 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:21:56.052734 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:21:56.093209 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6de07b32-361b-435e-85da-0d781a78b5a6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "POST /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165/action" status: 200 len: 32 microversion: 2.1 time: 0.161007 May 23 17:21:56.093736 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 241/495] 10.222.0.46 () {60 vars in 1277 bytes} [Mon May 23 17:21:55 2022] POST /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165/action => generated 32 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 23 17:21:56.103013 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-ab7b880e-daa7-4f5a-bdd7-020863fda1be tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:56.103627 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-ab7b880e-daa7-4f5a-bdd7-020863fda1be tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:56.110470 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ab7b880e-daa7-4f5a-bdd7-020863fda1be tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:56.110921 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ab7b880e-daa7-4f5a-bdd7-020863fda1be tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:56.112113 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ab7b880e-daa7-4f5a-bdd7-020863fda1be tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:56.112551 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ab7b880e-daa7-4f5a-bdd7-020863fda1be tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:56.514870 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-36875a3e-5839-4fc2-8b9c-32d7b6f6af17 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:56.515248 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ab7b880e-daa7-4f5a-bdd7-020863fda1be tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:56.515580 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-36875a3e-5839-4fc2-8b9c-32d7b6f6af17 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:56.522499 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-36875a3e-5839-4fc2-8b9c-32d7b6f6af17 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:56.522960 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-36875a3e-5839-4fc2-8b9c-32d7b6f6af17 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:56.523386 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-ab7b880e-daa7-4f5a-bdd7-020863fda1be tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1735 microversion: 2.1 time: 0.424285 May 23 17:21:56.523736 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-36875a3e-5839-4fc2-8b9c-32d7b6f6af17 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:56.524048 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 255/496] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:21:56 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1735 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:21:56.524217 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-36875a3e-5839-4fc2-8b9c-32d7b6f6af17 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:56.714420 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-36875a3e-5839-4fc2-8b9c-32d7b6f6af17 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:56.722553 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-36875a3e-5839-4fc2-8b9c-32d7b6f6af17 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1757 microversion: 2.1 time: 0.212461 May 23 17:21:56.723087 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 242/497] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:21:56 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1757 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:21:57.056523 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-ba7fb3e6-7323-4538-9dbd-5996f02a4b4f tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:57.057160 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-ba7fb3e6-7323-4538-9dbd-5996f02a4b4f tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 9ed3837e-0541-485a-9795-7aabaddcaec0] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:57.064080 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ba7fb3e6-7323-4538-9dbd-5996f02a4b4f tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:57.064521 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ba7fb3e6-7323-4538-9dbd-5996f02a4b4f tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:57.065360 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ba7fb3e6-7323-4538-9dbd-5996f02a4b4f tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:57.065794 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ba7fb3e6-7323-4538-9dbd-5996f02a4b4f tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:57.201006 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ba7fb3e6-7323-4538-9dbd-5996f02a4b4f tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:57.212133 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-ba7fb3e6-7323-4538-9dbd-5996f02a4b4f tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/9ed3837e-0541-485a-9795-7aabaddcaec0" status: 200 len: 1319 microversion: 2.1 time: 0.160485 May 23 17:21:57.212936 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 256/498] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:21:57 2022] GET /compute/v2.1/servers/9ed3837e-0541-485a-9795-7aabaddcaec0 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:21:57.540965 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ff735c25-e24c-4910-80d7-5b060631778d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:57.541535 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ff735c25-e24c-4910-80d7-5b060631778d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:57.548572 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ff735c25-e24c-4910-80d7-5b060631778d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:57.549061 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ff735c25-e24c-4910-80d7-5b060631778d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:57.549832 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ff735c25-e24c-4910-80d7-5b060631778d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:57.550267 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ff735c25-e24c-4910-80d7-5b060631778d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:57.607555 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=2 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:21:57.627740 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=6 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:21:57.682648 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ff735c25-e24c-4910-80d7-5b060631778d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:57.690802 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ff735c25-e24c-4910-80d7-5b060631778d tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1735 microversion: 2.1 time: 0.153946 May 23 17:21:57.691377 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 243/499] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:21:57 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:21:57.739281 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-1a127572-7db3-4108-b0d0-4d1aa4f08a5b tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:57.739912 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-1a127572-7db3-4108-b0d0-4d1aa4f08a5b tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:57.746374 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1a127572-7db3-4108-b0d0-4d1aa4f08a5b tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:57.746820 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1a127572-7db3-4108-b0d0-4d1aa4f08a5b tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:57.747575 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1a127572-7db3-4108-b0d0-4d1aa4f08a5b tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:57.748000 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1a127572-7db3-4108-b0d0-4d1aa4f08a5b tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:57.750656 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=2 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:21:57.903635 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-1a127572-7db3-4108-b0d0-4d1aa4f08a5b tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:57.911907 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-1a127572-7db3-4108-b0d0-4d1aa4f08a5b tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1757 microversion: 2.1 time: 0.176576 May 23 17:21:57.912485 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 257/500] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:21:57 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:21:58.235017 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a92871f9-42d4-4503-b615-067ad3eb03be tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:58.236122 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a92871f9-42d4-4503-b615-067ad3eb03be tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 9ed3837e-0541-485a-9795-7aabaddcaec0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:58.246407 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a92871f9-42d4-4503-b615-067ad3eb03be tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:58.247161 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a92871f9-42d4-4503-b615-067ad3eb03be tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:58.248558 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a92871f9-42d4-4503-b615-067ad3eb03be tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:58.249228 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a92871f9-42d4-4503-b615-067ad3eb03be tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:58.397495 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a92871f9-42d4-4503-b615-067ad3eb03be tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:58.405355 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a92871f9-42d4-4503-b615-067ad3eb03be tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/9ed3837e-0541-485a-9795-7aabaddcaec0" status: 200 len: 1508 microversion: 2.1 time: 0.176983 May 23 17:21:58.405999 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 244/501] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:21:58 2022] GET /compute/v2.1/servers/9ed3837e-0541-485a-9795-7aabaddcaec0 => generated 1508 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:21:58.421945 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d49bd873-6791-4591-9d95-cc7f0ec8d50b tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "28896e06-84b9-4134-af53-24dd34689437", "device": "/dev/sdb"}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:21:58.423130 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d49bd873-6791-4591-9d95-cc7f0ec8d50b tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 9ed3837e-0541-485a-9795-7aabaddcaec0] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:58.429965 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d49bd873-6791-4591-9d95-cc7f0ec8d50b tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:58.430540 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d49bd873-6791-4591-9d95-cc7f0ec8d50b tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:58.431296 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d49bd873-6791-4591-9d95-cc7f0ec8d50b tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:58.431738 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d49bd873-6791-4591-9d95-cc7f0ec8d50b tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:58.686313 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d49bd873-6791-4591-9d95-cc7f0ec8d50b tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "POST /compute/v2.1/servers/9ed3837e-0541-485a-9795-7aabaddcaec0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268149 May 23 17:21:58.686974 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 258/502] 10.222.0.46 () {60 vars in 1322 bytes} [Mon May 23 17:21:58 2022] POST /compute/v2.1/servers/9ed3837e-0541-485a-9795-7aabaddcaec0/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:21:58.710153 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-dc50a048-31ff-44a6-bc8b-ce6fe745f974 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:58.710788 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-dc50a048-31ff-44a6-bc8b-ce6fe745f974 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:58.717677 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dc50a048-31ff-44a6-bc8b-ce6fe745f974 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:58.718125 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dc50a048-31ff-44a6-bc8b-ce6fe745f974 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:58.719295 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dc50a048-31ff-44a6-bc8b-ce6fe745f974 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:58.724348 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dc50a048-31ff-44a6-bc8b-ce6fe745f974 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:58.856733 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-dc50a048-31ff-44a6-bc8b-ce6fe745f974 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:58.864915 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-dc50a048-31ff-44a6-bc8b-ce6fe745f974 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1735 microversion: 2.1 time: 0.159960 May 23 17:21:58.865486 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 245/503] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:21:58 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:21:58.934387 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-be3c0356-392c-423e-b06a-9b6169faf8f5 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:58.935492 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-be3c0356-392c-423e-b06a-9b6169faf8f5 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:58.944285 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-be3c0356-392c-423e-b06a-9b6169faf8f5 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:58.945025 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-be3c0356-392c-423e-b06a-9b6169faf8f5 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:58.946220 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-be3c0356-392c-423e-b06a-9b6169faf8f5 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:58.946782 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-be3c0356-392c-423e-b06a-9b6169faf8f5 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:59.103860 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-be3c0356-392c-423e-b06a-9b6169faf8f5 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:21:59.112281 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-be3c0356-392c-423e-b06a-9b6169faf8f5 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1757 microversion: 2.1 time: 0.185545 May 23 17:21:59.112981 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 259/504] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:21:58 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1757 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:21:59.886242 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3ed1155c-63a7-42b6-95ce-2b6815e36bd6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:21:59.887263 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3ed1155c-63a7-42b6-95ce-2b6815e36bd6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:21:59.898681 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3ed1155c-63a7-42b6-95ce-2b6815e36bd6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:59.899481 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3ed1155c-63a7-42b6-95ce-2b6815e36bd6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:21:59.900881 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3ed1155c-63a7-42b6-95ce-2b6815e36bd6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:21:59.901621 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3ed1155c-63a7-42b6-95ce-2b6815e36bd6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:00.044479 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3ed1155c-63a7-42b6-95ce-2b6815e36bd6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:00.053105 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3ed1155c-63a7-42b6-95ce-2b6815e36bd6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1735 microversion: 2.1 time: 0.173389 May 23 17:22:00.053658 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 246/505] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:21:59 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:00.132517 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d0992dab-e99d-4684-862c-6e88d2e64503 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:00.133426 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d0992dab-e99d-4684-862c-6e88d2e64503 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:00.141632 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d0992dab-e99d-4684-862c-6e88d2e64503 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:00.142110 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d0992dab-e99d-4684-862c-6e88d2e64503 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:00.142893 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d0992dab-e99d-4684-862c-6e88d2e64503 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:00.143333 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d0992dab-e99d-4684-862c-6e88d2e64503 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:00.290476 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d0992dab-e99d-4684-862c-6e88d2e64503 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:00.298681 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d0992dab-e99d-4684-862c-6e88d2e64503 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1757 microversion: 2.1 time: 0.171677 May 23 17:22:00.299223 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 260/506] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:00 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:01.074334 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-62424bca-c90b-4f16-8c11-9cbaa9d7eb8a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:01.074992 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-62424bca-c90b-4f16-8c11-9cbaa9d7eb8a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:01.081999 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-62424bca-c90b-4f16-8c11-9cbaa9d7eb8a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:01.082446 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-62424bca-c90b-4f16-8c11-9cbaa9d7eb8a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:01.083207 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-62424bca-c90b-4f16-8c11-9cbaa9d7eb8a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:01.083636 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-62424bca-c90b-4f16-8c11-9cbaa9d7eb8a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:01.214816 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-62424bca-c90b-4f16-8c11-9cbaa9d7eb8a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:01.223081 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-62424bca-c90b-4f16-8c11-9cbaa9d7eb8a tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1735 microversion: 2.1 time: 0.154868 May 23 17:22:01.223689 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 247/507] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:01 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:01.324997 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-03104702-5dcb-4e3e-ba58-e99302e6e4bb tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:01.325804 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-03104702-5dcb-4e3e-ba58-e99302e6e4bb tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:01.336878 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-03104702-5dcb-4e3e-ba58-e99302e6e4bb tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:01.337634 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-03104702-5dcb-4e3e-ba58-e99302e6e4bb tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:01.338925 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-03104702-5dcb-4e3e-ba58-e99302e6e4bb tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:01.339389 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-03104702-5dcb-4e3e-ba58-e99302e6e4bb tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:01.343449 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:22:01.493896 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-03104702-5dcb-4e3e-ba58-e99302e6e4bb tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:01.502315 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-03104702-5dcb-4e3e-ba58-e99302e6e4bb tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1757 microversion: 2.1 time: 0.184020 May 23 17:22:01.502900 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 261/508] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:01 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1757 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:01.760882 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ad7902d4-7a86-48e9-863f-a42de7ecf6c0 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:01.761379 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ad7902d4-7a86-48e9-863f-a42de7ecf6c0 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:01.768540 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ad7902d4-7a86-48e9-863f-a42de7ecf6c0 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:01.769029 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ad7902d4-7a86-48e9-863f-a42de7ecf6c0 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:01.769783 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ad7902d4-7a86-48e9-863f-a42de7ecf6c0 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:01.770208 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ad7902d4-7a86-48e9-863f-a42de7ecf6c0 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:01.802195 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ad7902d4-7a86-48e9-863f-a42de7ecf6c0 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091/os-volume_attachments/3dbf6793-e8da-4bb8-b1fe-7daee830a58e" status: 200 len: 194 microversion: 2.20 time: 0.048191 May 23 17:22:01.802794 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 248/509] 10.222.0.46 () {60 vars in 1453 bytes} [Mon May 23 17:22:01 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091/os-volume_attachments/3dbf6793-e8da-4bb8-b1fe-7daee830a58e => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 17:22:01.868332 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-758b1f50-6f33-47fd-988f-f89585bab9a6 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:01.868866 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-758b1f50-6f33-47fd-988f-f89585bab9a6 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:01.875080 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-758b1f50-6f33-47fd-988f-f89585bab9a6 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:01.875583 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-758b1f50-6f33-47fd-988f-f89585bab9a6 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:01.876271 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-758b1f50-6f33-47fd-988f-f89585bab9a6 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:01.876740 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-758b1f50-6f33-47fd-988f-f89585bab9a6 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:01.962716 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.objects.instance [None req-758b1f50-6f33-47fd-988f-f89585bab9a6 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lazy-loading 'services' on Instance uuid f4273c3a-0aba-4184-b088-2feaea1b1091 {{(pid=117910) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 17:22:02.054197 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-758b1f50-6f33-47fd-988f-f89585bab9a6 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091/os-volume_attachments/3dbf6793-e8da-4bb8-b1fe-7daee830a58e" status: 202 len: 0 microversion: 2.20 time: 0.189453 May 23 17:22:02.054960 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 262/510] 10.222.0.46 () {60 vars in 1456 bytes} [Mon May 23 17:22:01 2022] DELETE /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091/os-volume_attachments/3dbf6793-e8da-4bb8-b1fe-7daee830a58e => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 17:22:02.065190 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f73f2845-8fdd-44e1-a5c9-1375921135a8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:02.066186 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f73f2845-8fdd-44e1-a5c9-1375921135a8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:02.073187 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f73f2845-8fdd-44e1-a5c9-1375921135a8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:02.073629 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f73f2845-8fdd-44e1-a5c9-1375921135a8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:02.074389 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f73f2845-8fdd-44e1-a5c9-1375921135a8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:02.075824 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f73f2845-8fdd-44e1-a5c9-1375921135a8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:02.107718 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f73f2845-8fdd-44e1-a5c9-1375921135a8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046845 May 23 17:22:02.108298 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 249/511] 10.222.0.46 () {60 vars in 1342 bytes} [Mon May 23 17:22:02 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 17:22:02.245438 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-3fc73251-096a-44d9-8e3b-648d011a0a6e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:02.246090 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-3fc73251-096a-44d9-8e3b-648d011a0a6e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:02.252843 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3fc73251-096a-44d9-8e3b-648d011a0a6e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:02.253292 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3fc73251-096a-44d9-8e3b-648d011a0a6e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:02.254058 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3fc73251-096a-44d9-8e3b-648d011a0a6e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:02.254494 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3fc73251-096a-44d9-8e3b-648d011a0a6e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:02.382423 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-3fc73251-096a-44d9-8e3b-648d011a0a6e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:02.391041 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-3fc73251-096a-44d9-8e3b-648d011a0a6e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1735 microversion: 2.1 time: 0.152836 May 23 17:22:02.391634 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 263/512] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:02 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:02.521769 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-84a9a62f-1a1f-4869-893c-d5e2ce388f55 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:02.522426 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-84a9a62f-1a1f-4869-893c-d5e2ce388f55 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:02.529283 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-84a9a62f-1a1f-4869-893c-d5e2ce388f55 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:02.529854 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-84a9a62f-1a1f-4869-893c-d5e2ce388f55 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:02.530725 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-84a9a62f-1a1f-4869-893c-d5e2ce388f55 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:02.531256 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-84a9a62f-1a1f-4869-893c-d5e2ce388f55 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:02.669265 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-84a9a62f-1a1f-4869-893c-d5e2ce388f55 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:02.679191 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-84a9a62f-1a1f-4869-893c-d5e2ce388f55 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1757 microversion: 2.1 time: 0.163334 May 23 17:22:02.679975 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 250/513] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:02 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:03.124093 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-0283220c-305a-4210-bf07-d2974b4f2ecc tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:03.125684 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-0283220c-305a-4210-bf07-d2974b4f2ecc tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:03.136057 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0283220c-305a-4210-bf07-d2974b4f2ecc tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:03.136510 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0283220c-305a-4210-bf07-d2974b4f2ecc tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:03.137692 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0283220c-305a-4210-bf07-d2974b4f2ecc tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:03.138134 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0283220c-305a-4210-bf07-d2974b4f2ecc tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:03.174168 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-0283220c-305a-4210-bf07-d2974b4f2ecc tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057102 May 23 17:22:03.174757 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 264/514] 10.222.0.46 () {60 vars in 1342 bytes} [Mon May 23 17:22:03 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 17:22:03.411250 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b0f0af51-12ca-4465-acf8-5df3eccfd6f3 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:03.412215 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b0f0af51-12ca-4465-acf8-5df3eccfd6f3 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:03.421348 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b0f0af51-12ca-4465-acf8-5df3eccfd6f3 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:03.421795 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b0f0af51-12ca-4465-acf8-5df3eccfd6f3 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:03.422557 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b0f0af51-12ca-4465-acf8-5df3eccfd6f3 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:03.422985 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b0f0af51-12ca-4465-acf8-5df3eccfd6f3 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:03.557441 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b0f0af51-12ca-4465-acf8-5df3eccfd6f3 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:03.565746 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b0f0af51-12ca-4465-acf8-5df3eccfd6f3 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1735 microversion: 2.1 time: 0.161036 May 23 17:22:03.566322 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 251/515] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:03 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:03.696421 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-3684d4ce-6d89-4f52-b29d-76479fcd7dac tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:03.697082 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-3684d4ce-6d89-4f52-b29d-76479fcd7dac tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:03.705075 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3684d4ce-6d89-4f52-b29d-76479fcd7dac tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:03.705525 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3684d4ce-6d89-4f52-b29d-76479fcd7dac tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:03.706296 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3684d4ce-6d89-4f52-b29d-76479fcd7dac tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:03.706734 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3684d4ce-6d89-4f52-b29d-76479fcd7dac tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:03.861240 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-3684d4ce-6d89-4f52-b29d-76479fcd7dac tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:03.873546 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-3684d4ce-6d89-4f52-b29d-76479fcd7dac tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1757 microversion: 2.1 time: 0.180742 May 23 17:22:03.874079 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 265/516] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:03 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:04.191069 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a6b7bf75-c35a-4182-9342-f62639d2c7a0 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:04.192678 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a6b7bf75-c35a-4182-9342-f62639d2c7a0 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:04.201322 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a6b7bf75-c35a-4182-9342-f62639d2c7a0 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:04.201795 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a6b7bf75-c35a-4182-9342-f62639d2c7a0 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:04.202531 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a6b7bf75-c35a-4182-9342-f62639d2c7a0 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:04.202960 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a6b7bf75-c35a-4182-9342-f62639d2c7a0 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:04.232960 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a6b7bf75-c35a-4182-9342-f62639d2c7a0 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048664 May 23 17:22:04.233512 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 252/517] 10.222.0.46 () {60 vars in 1342 bytes} [Mon May 23 17:22:04 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 17:22:04.591062 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-7f3e9b34-b7da-4639-870c-0da944c7480f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:04.591983 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-7f3e9b34-b7da-4639-870c-0da944c7480f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:04.594854 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=49 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:22:04.603459 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7f3e9b34-b7da-4639-870c-0da944c7480f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:04.604067 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7f3e9b34-b7da-4639-870c-0da944c7480f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:04.605019 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7f3e9b34-b7da-4639-870c-0da944c7480f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:04.605454 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7f3e9b34-b7da-4639-870c-0da944c7480f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:04.746470 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-7f3e9b34-b7da-4639-870c-0da944c7480f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:04.755224 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-7f3e9b34-b7da-4639-870c-0da944c7480f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1735 microversion: 2.1 time: 0.170510 May 23 17:22:04.755809 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 266/518] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:04 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:04.893362 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-229a4575-7efe-4ce1-bbba-543a3049518c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:04.894060 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-229a4575-7efe-4ce1-bbba-543a3049518c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:04.903030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-229a4575-7efe-4ce1-bbba-543a3049518c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:04.903632 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-229a4575-7efe-4ce1-bbba-543a3049518c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:04.904862 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-229a4575-7efe-4ce1-bbba-543a3049518c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:04.905451 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-229a4575-7efe-4ce1-bbba-543a3049518c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:05.055249 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-229a4575-7efe-4ce1-bbba-543a3049518c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:05.064301 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-229a4575-7efe-4ce1-bbba-543a3049518c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1757 microversion: 2.1 time: 0.176872 May 23 17:22:05.064934 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 253/519] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:04 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:05.244842 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-80ebde2d-9d59-4542-bd58-4a8f87849376 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:05.245847 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-80ebde2d-9d59-4542-bd58-4a8f87849376 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:05.252055 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-80ebde2d-9d59-4542-bd58-4a8f87849376 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:05.252509 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-80ebde2d-9d59-4542-bd58-4a8f87849376 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:05.253315 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-80ebde2d-9d59-4542-bd58-4a8f87849376 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:05.253754 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-80ebde2d-9d59-4542-bd58-4a8f87849376 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:05.283007 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-80ebde2d-9d59-4542-bd58-4a8f87849376 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042216 May 23 17:22:05.283565 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 267/520] 10.222.0.46 () {60 vars in 1342 bytes} [Mon May 23 17:22:05 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 17:22:05.773266 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e71fe08d-fae4-460f-8604-2c4156a3cf08 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:05.773875 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e71fe08d-fae4-460f-8604-2c4156a3cf08 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:05.775770 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:22:05.781681 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e71fe08d-fae4-460f-8604-2c4156a3cf08 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:05.782120 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e71fe08d-fae4-460f-8604-2c4156a3cf08 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:05.782882 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e71fe08d-fae4-460f-8604-2c4156a3cf08 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:05.783312 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e71fe08d-fae4-460f-8604-2c4156a3cf08 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:05.909801 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e71fe08d-fae4-460f-8604-2c4156a3cf08 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:05.918261 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e71fe08d-fae4-460f-8604-2c4156a3cf08 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1735 microversion: 2.1 time: 0.148818 May 23 17:22:05.918958 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 254/521] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:05 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:06.082342 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2df68186-04b1-4018-b37b-eff846a4b7d4 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:06.082947 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2df68186-04b1-4018-b37b-eff846a4b7d4 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:06.089807 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2df68186-04b1-4018-b37b-eff846a4b7d4 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:06.090259 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2df68186-04b1-4018-b37b-eff846a4b7d4 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:06.091028 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2df68186-04b1-4018-b37b-eff846a4b7d4 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:06.091462 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2df68186-04b1-4018-b37b-eff846a4b7d4 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:06.239865 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2df68186-04b1-4018-b37b-eff846a4b7d4 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:06.248305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2df68186-04b1-4018-b37b-eff846a4b7d4 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1757 microversion: 2.1 time: 0.170285 May 23 17:22:06.259021 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 268/522] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:06 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:06.298283 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1871daa0-983e-4606-a149-fd13283fd8ea tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:06.299216 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1871daa0-983e-4606-a149-fd13283fd8ea tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:06.306623 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1871daa0-983e-4606-a149-fd13283fd8ea tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:06.307073 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1871daa0-983e-4606-a149-fd13283fd8ea tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:06.307847 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1871daa0-983e-4606-a149-fd13283fd8ea tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:06.308286 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1871daa0-983e-4606-a149-fd13283fd8ea tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:06.339559 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1871daa0-983e-4606-a149-fd13283fd8ea tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045677 May 23 17:22:06.340207 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 255/523] 10.222.0.46 () {60 vars in 1342 bytes} [Mon May 23 17:22:06 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:06.398467 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-f1cc916a-ef71-438c-a67b-03d28e42e84a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:06.399001 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-f1cc916a-ef71-438c-a67b-03d28e42e84a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:06.405455 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f1cc916a-ef71-438c-a67b-03d28e42e84a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:06.405911 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f1cc916a-ef71-438c-a67b-03d28e42e84a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:06.406683 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f1cc916a-ef71-438c-a67b-03d28e42e84a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:06.407121 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f1cc916a-ef71-438c-a67b-03d28e42e84a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:06.433095 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-f1cc916a-ef71-438c-a67b-03d28e42e84a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Going to try to terminate instance {{(pid=117910) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 17:22:06.525888 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-f1cc916a-ef71-438c-a67b-03d28e42e84a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 204 len: 0 microversion: 2.20 time: 0.131164 May 23 17:22:06.526382 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 269/524] 10.222.0.46 () {60 vars in 1279 bytes} [Mon May 23 17:22:06 2022] DELETE /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 23 17:22:06.534990 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6795de73-37ba-49f4-8ce5-1172622ba8f3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:06.535633 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6795de73-37ba-49f4-8ce5-1172622ba8f3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:06.542089 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6795de73-37ba-49f4-8ce5-1172622ba8f3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:06.542532 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6795de73-37ba-49f4-8ce5-1172622ba8f3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:06.543318 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6795de73-37ba-49f4-8ce5-1172622ba8f3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:06.543739 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6795de73-37ba-49f4-8ce5-1172622ba8f3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:06.672129 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6795de73-37ba-49f4-8ce5-1172622ba8f3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:06.680475 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6795de73-37ba-49f4-8ce5-1172622ba8f3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:06.682029 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6795de73-37ba-49f4-8ce5-1172622ba8f3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:06.683186 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6795de73-37ba-49f4-8ce5-1172622ba8f3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1724 microversion: 2.20 time: 0.152360 May 23 17:22:06.683808 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 256/525] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:22:06 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:22:06.941598 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-33affece-710a-493d-97a9-9ac0975205f1 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:06.942764 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-33affece-710a-493d-97a9-9ac0975205f1 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:06.951477 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-33affece-710a-493d-97a9-9ac0975205f1 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:06.952234 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-33affece-710a-493d-97a9-9ac0975205f1 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:06.953215 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-33affece-710a-493d-97a9-9ac0975205f1 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:06.953802 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-33affece-710a-493d-97a9-9ac0975205f1 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:07.089310 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-33affece-710a-493d-97a9-9ac0975205f1 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:07.101247 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-33affece-710a-493d-97a9-9ac0975205f1 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1735 microversion: 2.1 time: 0.165713 May 23 17:22:07.101890 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 270/526] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:06 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:07.271236 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-befed075-63c9-4ae9-a7ed-f901d13aca4d tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:07.272321 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-befed075-63c9-4ae9-a7ed-f901d13aca4d tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:07.281291 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-befed075-63c9-4ae9-a7ed-f901d13aca4d tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:07.281736 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-befed075-63c9-4ae9-a7ed-f901d13aca4d tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:07.282504 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-befed075-63c9-4ae9-a7ed-f901d13aca4d tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:07.282942 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-befed075-63c9-4ae9-a7ed-f901d13aca4d tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:07.303014 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:22:07.440430 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-befed075-63c9-4ae9-a7ed-f901d13aca4d tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:07.452669 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-befed075-63c9-4ae9-a7ed-f901d13aca4d tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1757 microversion: 2.1 time: 0.187940 May 23 17:22:07.453639 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 257/527] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:07 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1757 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:07.703755 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-4bdedbe2-13ea-415b-962c-2ddc70af7099 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:07.704395 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-4bdedbe2-13ea-415b-962c-2ddc70af7099 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:07.710819 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4bdedbe2-13ea-415b-962c-2ddc70af7099 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:07.711273 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4bdedbe2-13ea-415b-962c-2ddc70af7099 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:07.712027 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4bdedbe2-13ea-415b-962c-2ddc70af7099 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:07.712459 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4bdedbe2-13ea-415b-962c-2ddc70af7099 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:07.854021 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-4bdedbe2-13ea-415b-962c-2ddc70af7099 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:07.864910 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-4bdedbe2-13ea-415b-962c-2ddc70af7099 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:07.867254 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-4bdedbe2-13ea-415b-962c-2ddc70af7099 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:07.869034 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-4bdedbe2-13ea-415b-962c-2ddc70af7099 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1724 microversion: 2.20 time: 0.169451 May 23 17:22:07.869830 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 271/528] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:22:07 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:22:08.123027 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e098892e-358a-4029-b356-80070042b07b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:08.123579 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e098892e-358a-4029-b356-80070042b07b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:08.130757 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e098892e-358a-4029-b356-80070042b07b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:08.131235 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e098892e-358a-4029-b356-80070042b07b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:08.132047 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e098892e-358a-4029-b356-80070042b07b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:08.132544 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e098892e-358a-4029-b356-80070042b07b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:08.270489 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e098892e-358a-4029-b356-80070042b07b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:08.279224 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e098892e-358a-4029-b356-80070042b07b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1735 microversion: 2.1 time: 0.162404 May 23 17:22:08.279826 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 258/529] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:08 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:08.478906 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-6446a66f-bc90-4f7f-b627-0debdf5cc801 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:08.479918 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-6446a66f-bc90-4f7f-b627-0debdf5cc801 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:08.487542 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6446a66f-bc90-4f7f-b627-0debdf5cc801 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:08.488019 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6446a66f-bc90-4f7f-b627-0debdf5cc801 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:08.488863 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6446a66f-bc90-4f7f-b627-0debdf5cc801 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:08.489325 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6446a66f-bc90-4f7f-b627-0debdf5cc801 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:08.629960 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-6446a66f-bc90-4f7f-b627-0debdf5cc801 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:08.638952 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-6446a66f-bc90-4f7f-b627-0debdf5cc801 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1757 microversion: 2.1 time: 0.166558 May 23 17:22:08.639530 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 272/530] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:08 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:08.892342 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b1fb8825-4908-4c62-af22-92a8c7cb100d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:08.893316 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b1fb8825-4908-4c62-af22-92a8c7cb100d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:08.903241 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b1fb8825-4908-4c62-af22-92a8c7cb100d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:08.903694 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b1fb8825-4908-4c62-af22-92a8c7cb100d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:08.904463 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b1fb8825-4908-4c62-af22-92a8c7cb100d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:08.904939 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b1fb8825-4908-4c62-af22-92a8c7cb100d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:09.052263 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b1fb8825-4908-4c62-af22-92a8c7cb100d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:09.064468 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b1fb8825-4908-4c62-af22-92a8c7cb100d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:09.066871 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b1fb8825-4908-4c62-af22-92a8c7cb100d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:09.068734 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b1fb8825-4908-4c62-af22-92a8c7cb100d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1724 microversion: 2.20 time: 0.183181 May 23 17:22:09.069458 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 259/531] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:22:08 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:22:09.301063 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-4f8a4e03-b8a2-4110-ad51-ca5cbf8597bf tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:09.302072 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-4f8a4e03-b8a2-4110-ad51-ca5cbf8597bf tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:09.312586 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4f8a4e03-b8a2-4110-ad51-ca5cbf8597bf tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:09.313398 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4f8a4e03-b8a2-4110-ad51-ca5cbf8597bf tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:09.314635 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4f8a4e03-b8a2-4110-ad51-ca5cbf8597bf tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:09.315384 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4f8a4e03-b8a2-4110-ad51-ca5cbf8597bf tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:09.459417 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-4f8a4e03-b8a2-4110-ad51-ca5cbf8597bf tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:09.467762 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-4f8a4e03-b8a2-4110-ad51-ca5cbf8597bf tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1735 microversion: 2.1 time: 0.173293 May 23 17:22:09.468341 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 273/532] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:09 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:09.666120 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-03199f1b-a993-4fba-a4b8-7bbfb900dd26 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:09.666862 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-03199f1b-a993-4fba-a4b8-7bbfb900dd26 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:09.678515 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-03199f1b-a993-4fba-a4b8-7bbfb900dd26 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:09.679106 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-03199f1b-a993-4fba-a4b8-7bbfb900dd26 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:09.680145 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-03199f1b-a993-4fba-a4b8-7bbfb900dd26 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:09.681224 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-03199f1b-a993-4fba-a4b8-7bbfb900dd26 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:09.843257 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-03199f1b-a993-4fba-a4b8-7bbfb900dd26 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:09.851884 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-03199f1b-a993-4fba-a4b8-7bbfb900dd26 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1757 microversion: 2.1 time: 0.193858 May 23 17:22:09.852454 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 260/533] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:09 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1757 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:10.089087 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-45a9f7b8-0d8b-4722-8242-b45cbbe3fad3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:10.089691 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-45a9f7b8-0d8b-4722-8242-b45cbbe3fad3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:10.096716 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-45a9f7b8-0d8b-4722-8242-b45cbbe3fad3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:10.097165 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-45a9f7b8-0d8b-4722-8242-b45cbbe3fad3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:10.097937 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-45a9f7b8-0d8b-4722-8242-b45cbbe3fad3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:10.098369 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-45a9f7b8-0d8b-4722-8242-b45cbbe3fad3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:10.346876 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-45a9f7b8-0d8b-4722-8242-b45cbbe3fad3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:10.355042 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-45a9f7b8-0d8b-4722-8242-b45cbbe3fad3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:10.356625 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-45a9f7b8-0d8b-4722-8242-b45cbbe3fad3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:10.357787 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-45a9f7b8-0d8b-4722-8242-b45cbbe3fad3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1724 microversion: 2.20 time: 0.272655 May 23 17:22:10.358379 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 274/534] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:22:10 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1724 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:22:10.486962 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-048ac3fe-4398-4348-95a2-c4a7c38d67fa tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:10.487930 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-048ac3fe-4398-4348-95a2-c4a7c38d67fa tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:10.497285 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-048ac3fe-4398-4348-95a2-c4a7c38d67fa tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:10.497687 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-048ac3fe-4398-4348-95a2-c4a7c38d67fa tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:10.498526 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-048ac3fe-4398-4348-95a2-c4a7c38d67fa tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:10.498960 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-048ac3fe-4398-4348-95a2-c4a7c38d67fa tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:10.689666 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-048ac3fe-4398-4348-95a2-c4a7c38d67fa tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:10.698134 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-048ac3fe-4398-4348-95a2-c4a7c38d67fa tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1735 microversion: 2.1 time: 0.216749 May 23 17:22:10.698755 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 261/535] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:10 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1735 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:10.869089 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-977c13e6-e356-484d-8a6d-5ee2a19cdccf tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:10.870135 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-977c13e6-e356-484d-8a6d-5ee2a19cdccf tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:10.876781 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-977c13e6-e356-484d-8a6d-5ee2a19cdccf tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:10.877354 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-977c13e6-e356-484d-8a6d-5ee2a19cdccf tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:10.878228 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-977c13e6-e356-484d-8a6d-5ee2a19cdccf tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:10.878770 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-977c13e6-e356-484d-8a6d-5ee2a19cdccf tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:10.900235 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:22:11.071692 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-66d6e6c3-6c58-48ea-afaf-1c397f82232f req-8bc7d872-0e9c-4e56-b2fe-f82704fcc546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4273c3a-0aba-4184-b088-2feaea1b1091", "name": "network-vif-deleted", "tag": "0c234a65-eea7-4bdf-ac00-34147e4abec0"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:22:11.084260 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-66d6e6c3-6c58-48ea-afaf-1c397f82232f req-8bc7d872-0e9c-4e56-b2fe-f82704fcc546 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:11.085064 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-66d6e6c3-6c58-48ea-afaf-1c397f82232f req-8bc7d872-0e9c-4e56-b2fe-f82704fcc546 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:11.102727 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-66d6e6c3-6c58-48ea-afaf-1c397f82232f req-8bc7d872-0e9c-4e56-b2fe-f82704fcc546 service nova] Creating event network-vif-deleted:0c234a65-eea7-4bdf-ac00-34147e4abec0 for instance f4273c3a-0aba-4184-b088-2feaea1b1091 on hv-cinder-84299 May 23 17:22:11.110407 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-66d6e6c3-6c58-48ea-afaf-1c397f82232f req-8bc7d872-0e9c-4e56-b2fe-f82704fcc546 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042496 May 23 17:22:11.113823 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 262/536] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 17:22:11.128364 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-977c13e6-e356-484d-8a6d-5ee2a19cdccf tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:11.139858 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-977c13e6-e356-484d-8a6d-5ee2a19cdccf tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1757 microversion: 2.1 time: 0.274563 May 23 17:22:11.140775 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 275/537] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:10 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1757 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:11.376082 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-de42e61a-9282-4ade-b20e-a749523e9ed1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:11.376779 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-de42e61a-9282-4ade-b20e-a749523e9ed1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:11.383319 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-de42e61a-9282-4ade-b20e-a749523e9ed1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:11.383765 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-de42e61a-9282-4ade-b20e-a749523e9ed1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:11.384518 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-de42e61a-9282-4ade-b20e-a749523e9ed1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:11.385001 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-de42e61a-9282-4ade-b20e-a749523e9ed1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:11.447649 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-de42e61a-9282-4ade-b20e-a749523e9ed1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:11.461757 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-de42e61a-9282-4ade-b20e-a749523e9ed1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:11.464017 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-de42e61a-9282-4ade-b20e-a749523e9ed1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:11.465612 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-de42e61a-9282-4ade-b20e-a749523e9ed1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1656 microversion: 2.20 time: 0.093970 May 23 17:22:11.466617 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 263/538] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:22:11 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1656 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:22:11.715643 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-9f9ea44a-57c1-4cf3-b85c-0c671d0a61cc tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:11.716248 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-9f9ea44a-57c1-4cf3-b85c-0c671d0a61cc tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:11.722582 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9f9ea44a-57c1-4cf3-b85c-0c671d0a61cc tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:11.723032 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9f9ea44a-57c1-4cf3-b85c-0c671d0a61cc tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:11.723817 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9f9ea44a-57c1-4cf3-b85c-0c671d0a61cc tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:11.724253 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9f9ea44a-57c1-4cf3-b85c-0c671d0a61cc tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:11.866908 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9f9ea44a-57c1-4cf3-b85c-0c671d0a61cc tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:11.875641 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-9f9ea44a-57c1-4cf3-b85c-0c671d0a61cc tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1735 microversion: 2.1 time: 0.164051 May 23 17:22:11.876251 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 276/539] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:11 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:12.163261 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-717d3c90-760f-4930-833f-356c9448527c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:12.164094 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-717d3c90-760f-4930-833f-356c9448527c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:12.171764 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-717d3c90-760f-4930-833f-356c9448527c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:12.172518 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-717d3c90-760f-4930-833f-356c9448527c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:12.173363 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-717d3c90-760f-4930-833f-356c9448527c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:12.173812 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-717d3c90-760f-4930-833f-356c9448527c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:12.339193 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-717d3c90-760f-4930-833f-356c9448527c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:12.347412 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-717d3c90-760f-4930-833f-356c9448527c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1757 microversion: 2.1 time: 0.193649 May 23 17:22:12.347986 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 264/540] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:12 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1757 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:12.486307 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e03a0fa1-efab-4dd2-95b6-9dea10794bbe tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:12.487163 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-e03a0fa1-efab-4dd2-95b6-9dea10794bbe tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:12.494258 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e03a0fa1-efab-4dd2-95b6-9dea10794bbe tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:12.494709 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e03a0fa1-efab-4dd2-95b6-9dea10794bbe tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:12.495483 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e03a0fa1-efab-4dd2-95b6-9dea10794bbe tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:12.495922 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e03a0fa1-efab-4dd2-95b6-9dea10794bbe tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:12.571784 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e03a0fa1-efab-4dd2-95b6-9dea10794bbe tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:12.580061 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e03a0fa1-efab-4dd2-95b6-9dea10794bbe tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:12.581678 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e03a0fa1-efab-4dd2-95b6-9dea10794bbe tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:12.582908 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-e03a0fa1-efab-4dd2-95b6-9dea10794bbe tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1656 microversion: 2.20 time: 0.100817 May 23 17:22:12.583460 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 277/541] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:22:12 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1656 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:22:12.894482 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-51dd34aa-449d-440a-9749-49f079aee5ed tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:12.895204 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-51dd34aa-449d-440a-9749-49f079aee5ed tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:12.901771 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-51dd34aa-449d-440a-9749-49f079aee5ed tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:12.902222 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-51dd34aa-449d-440a-9749-49f079aee5ed tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:12.902990 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-51dd34aa-449d-440a-9749-49f079aee5ed tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:12.903425 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-51dd34aa-449d-440a-9749-49f079aee5ed tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:13.033630 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-51dd34aa-449d-440a-9749-49f079aee5ed tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:13.042860 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-51dd34aa-449d-440a-9749-49f079aee5ed tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1735 microversion: 2.1 time: 0.152332 May 23 17:22:13.043529 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 265/542] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:12 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:13.367233 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-61c7269f-115e-4e07-aa2b-0239d43b486f tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:13.368108 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-61c7269f-115e-4e07-aa2b-0239d43b486f tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:13.375515 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-61c7269f-115e-4e07-aa2b-0239d43b486f tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:13.375966 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-61c7269f-115e-4e07-aa2b-0239d43b486f tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:13.376758 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-61c7269f-115e-4e07-aa2b-0239d43b486f tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:13.377198 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-61c7269f-115e-4e07-aa2b-0239d43b486f tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:13.526269 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-61c7269f-115e-4e07-aa2b-0239d43b486f tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:13.535004 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-61c7269f-115e-4e07-aa2b-0239d43b486f tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1757 microversion: 2.1 time: 0.173067 May 23 17:22:13.535652 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 278/543] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:13 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:13.601958 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3cd9d135-b037-4a69-8f77-def20358162a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:13.602560 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3cd9d135-b037-4a69-8f77-def20358162a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:13.609068 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3cd9d135-b037-4a69-8f77-def20358162a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:13.609800 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3cd9d135-b037-4a69-8f77-def20358162a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:13.610578 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3cd9d135-b037-4a69-8f77-def20358162a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:13.611005 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3cd9d135-b037-4a69-8f77-def20358162a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:13.644637 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3cd9d135-b037-4a69-8f77-def20358162a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:13.645084 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3cd9d135-b037-4a69-8f77-def20358162a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:13.645526 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.objects.instance [None req-3cd9d135-b037-4a69-8f77-def20358162a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lazy-loading 'fault' on Instance uuid f4273c3a-0aba-4184-b088-2feaea1b1091 {{(pid=117909) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 17:22:13.697023 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3cd9d135-b037-4a69-8f77-def20358162a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:13.707010 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3cd9d135-b037-4a69-8f77-def20358162a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:13.708549 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3cd9d135-b037-4a69-8f77-def20358162a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:13.709772 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3cd9d135-b037-4a69-8f77-def20358162a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 200 len: 1371 microversion: 2.20 time: 0.111806 May 23 17:22:13.721138 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 266/544] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:22:13 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 1371 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 17:22:14.060420 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-979e96af-3aa5-4686-9d6c-62f623800e9f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:14.061052 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-979e96af-3aa5-4686-9d6c-62f623800e9f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:14.067660 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-979e96af-3aa5-4686-9d6c-62f623800e9f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:14.068216 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-979e96af-3aa5-4686-9d6c-62f623800e9f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:14.069440 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-979e96af-3aa5-4686-9d6c-62f623800e9f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:14.070072 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-979e96af-3aa5-4686-9d6c-62f623800e9f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:14.198592 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-979e96af-3aa5-4686-9d6c-62f623800e9f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:14.206748 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-979e96af-3aa5-4686-9d6c-62f623800e9f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1735 microversion: 2.1 time: 0.150900 May 23 17:22:14.207318 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 279/545] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:14 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:14.558119 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-69a98c76-68c1-4161-8850-3371b244cfc1 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:14.559330 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-69a98c76-68c1-4161-8850-3371b244cfc1 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:14.569962 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-69a98c76-68c1-4161-8850-3371b244cfc1 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:14.570701 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-69a98c76-68c1-4161-8850-3371b244cfc1 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:14.571972 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-69a98c76-68c1-4161-8850-3371b244cfc1 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:14.572747 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-69a98c76-68c1-4161-8850-3371b244cfc1 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:14.719521 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-69a98c76-68c1-4161-8850-3371b244cfc1 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:14.728383 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a2e662ba-1ebe-456a-9cff-cc168c7f4f59 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:14.729013 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-69a98c76-68c1-4161-8850-3371b244cfc1 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1757 microversion: 2.1 time: 0.178271 May 23 17:22:14.729136 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-a2e662ba-1ebe-456a-9cff-cc168c7f4f59 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:14.729720 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 267/546] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:14 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:14.735818 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a2e662ba-1ebe-456a-9cff-cc168c7f4f59 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:14.736382 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a2e662ba-1ebe-456a-9cff-cc168c7f4f59 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:14.737270 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a2e662ba-1ebe-456a-9cff-cc168c7f4f59 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:14.737792 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a2e662ba-1ebe-456a-9cff-cc168c7f4f59 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:14.751724 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-a2e662ba-1ebe-456a-9cff-cc168c7f4f59 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] HTTP exception thrown: Instance f4273c3a-0aba-4184-b088-2feaea1b1091 could not be found. May 23 17:22:14.753375 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a2e662ba-1ebe-456a-9cff-cc168c7f4f59 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Request method failure captured: May 23 17:22:14.753375 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: request: GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 HTTP/1.1 May 23 17:22:14.753375 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept: application/json May 23 17:22:14.753375 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity May 23 17:22:14.753375 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Connection: close May 23 17:22:14.753375 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Length: 0 May 23 17:22:14.753375 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Type: application/json May 23 17:22:14.753375 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Host: 10.222.0.46 May 23 17:22:14.753375 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None May 23 17:22:14.753375 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.9 May 23 17:22:14.753375 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABii8HA4AQZ8G3CbvjytFl_DCO_PsWDefbQHejYwJxf1bVsGWOZ4Emw88Glui5WzBUo3xGWTz7X02Cy3SBypDOKQywIxe-V1BcYK4IdaEluMfkLRjOFDuM_gPcfQoI18RMf4eC01wyP9LAS1CRm3vSVn1VQ-z6r1Yh5zrkw80OHdulI4YA May 23 17:22:14.753375 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Id: None May 23 17:22:14.753375 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Name: None May 23 17:22:14.753375 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed May 23 17:22:14.753375 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True May 23 17:22:14.753375 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Openstack-Nova-Api-Version: 2.20 May 23 17:22:14.753375 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default May 23 17:22:14.753375 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default May 23 17:22:14.753375 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Id: 5724b98399214909a99dec90c2718c44 May 23 17:22:14.753375 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1616966163 May 23 17:22:14.753375 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Role: reader,member May 23 17:22:14.753375 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Roles: reader,member May 23 17:22:14.754824 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5724b98399214909a99dec90c2718c44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5724b98399214909a99dec90c2718c44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5724b98399214909a99dec90c2718c44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5724b98399214909a99dec90c2718c44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:22:14.754824 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1616966163 May 23 17:22:14.754824 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 5724b98399214909a99dec90c2718c44 May 23 17:22:14.754824 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1616966163 May 23 17:22:14.754824 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User: tempest-AttachVolumeShelveTestJSON-1616966163-project May 23 17:22:14.754824 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default May 23 17:22:14.754824 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default May 23 17:22:14.754824 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Id: 8485b40daa3347d3a438c2006d9d4ef5 May 23 17:22:14.754824 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1616966163-project May 23 17:22:14.754824 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: method: > May 23 17:22:14.754824 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: exception: Instance f4273c3a-0aba-4184-b088-2feaea1b1091 could not be found. May 23 17:22:14.754824 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: action_args: {'id': 'f4273c3a-0aba-4184-b088-2feaea1b1091'} May 23 17:22:14.755662 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:22:14.755662 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:22:14.755662 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:22:14.755662 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:22:14.755662 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:22:14.755662 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:22:14.755662 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:22:14.755662 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:22:14.755662 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:22:14.755662 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:22:14.755662 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4273c3a-0aba-4184-b088-2feaea1b1091 could not be found. May 23 17:22:14.755662 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:22:14.755662 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:22:14.755662 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:22:14.755662 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:22:14.755662 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:22:14.755662 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:22:14.755662 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:22:14.755662 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:22:14.755662 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:22:14.757014 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:22:14.757014 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 17:22:14.757014 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 17:22:14.757014 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:22:14.757014 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:22:14.757014 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:22:14.757014 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:22:14.757014 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4273c3a-0aba-4184-b088-2feaea1b1091 could not be found. May 23 17:22:14.757014 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:22:14.757014 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:22:14.757014 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:22:14.757014 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:22:14.757014 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:22:14.757014 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:22:14.757014 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:22:14.757014 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:22:14.757014 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4273c3a-0aba-4184-b088-2feaea1b1091 could not be found. May 23 17:22:14.757014 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:22:14.758432 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a2e662ba-1ebe-456a-9cff-cc168c7f4f59 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Returning 404 to user: Instance f4273c3a-0aba-4184-b088-2feaea1b1091 could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:22:14.758432 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-a2e662ba-1ebe-456a-9cff-cc168c7f4f59 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 404 len: 111 microversion: 2.20 time: 0.030225 May 23 17:22:14.758432 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 280/547] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:22:14 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 23 17:22:14.764204 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9ef203ab-6002-4756-bdfe-074c465c0c7c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '.version_select at 0x7fd793e611f0>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:14.788621 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9ef203ab-6002-4756-bdfe-074c465c0c7c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1281113625" status: 204 len: 0 microversion: 2.20 time: 0.028531 May 23 17:22:14.792548 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 268/548] 10.222.0.46 () {60 vars in 1261 bytes} [Mon May 23 17:22:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1281113625 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 23 17:22:15.224217 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-3e8b5abc-8c67-436b-80a1-1872a41c9631 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:15.224882 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-3e8b5abc-8c67-436b-80a1-1872a41c9631 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:15.231353 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3e8b5abc-8c67-436b-80a1-1872a41c9631 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:15.231828 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3e8b5abc-8c67-436b-80a1-1872a41c9631 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:15.232731 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3e8b5abc-8c67-436b-80a1-1872a41c9631 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:15.233164 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3e8b5abc-8c67-436b-80a1-1872a41c9631 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:15.363538 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-3e8b5abc-8c67-436b-80a1-1872a41c9631 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:15.371873 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-3e8b5abc-8c67-436b-80a1-1872a41c9631 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1735 microversion: 2.1 time: 0.151617 May 23 17:22:15.372445 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 281/549] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:15 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:15.487868 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d875be73-0c95-4b34-bcbb-ed59e9ca542d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Action: 'create', calling method: .version_select at 0x7fd793e2e280>, body: {"keypair": {"name": "tempest-keypair-401533959", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIudHl4evIiuVkYkjmsgK2IFP5Mliew2lEzaP9yaBzTNikQd4DLnLkd1HJeamRL46h+pcjmYN2fgrZyS+ruhIJjadRbBT/ihIkJ8ogO9/eSbRyvQLypYtMS2WpYZa1UazA=="}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:22:15.503323 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-d875be73-0c95-4b34-bcbb-ed59e9ca542d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Getting quotas for project 5724b98399214909a99dec90c2718c44. Resources: {'key_pairs'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 17:22:15.507579 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-d875be73-0c95-4b34-bcbb-ed59e9ca542d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Getting quotas for user 8485b40daa3347d3a438c2006d9d4ef5 and project 5724b98399214909a99dec90c2718c44. Resources: {'key_pairs'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 17:22:15.534576 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d875be73-0c95-4b34-bcbb-ed59e9ca542d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.050937 May 23 17:22:15.535176 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 269/550] 10.222.0.46 () {62 vars in 1199 bytes} [Mon May 23 17:22:15 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 23 17:22:15.746445 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-faa73323-81c6-4748-a9f5-af243514cd19 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:15.747065 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-faa73323-81c6-4748-a9f5-af243514cd19 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:15.754230 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-faa73323-81c6-4748-a9f5-af243514cd19 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:15.754673 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-faa73323-81c6-4748-a9f5-af243514cd19 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:15.755455 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-faa73323-81c6-4748-a9f5-af243514cd19 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:15.755895 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-faa73323-81c6-4748-a9f5-af243514cd19 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:15.909343 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-faa73323-81c6-4748-a9f5-af243514cd19 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:15.918139 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-faa73323-81c6-4748-a9f5-af243514cd19 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1757 microversion: 2.1 time: 0.175658 May 23 17:22:15.919075 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 282/551] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:15 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:16.390632 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9a697f2d-71f4-4f39-b091-99dafa1dc8fe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:16.391250 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9a697f2d-71f4-4f39-b091-99dafa1dc8fe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:16.398719 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9a697f2d-71f4-4f39-b091-99dafa1dc8fe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:16.399251 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9a697f2d-71f4-4f39-b091-99dafa1dc8fe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:16.400202 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9a697f2d-71f4-4f39-b091-99dafa1dc8fe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:16.400742 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9a697f2d-71f4-4f39-b091-99dafa1dc8fe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:16.530706 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9a697f2d-71f4-4f39-b091-99dafa1dc8fe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:16.538956 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9a697f2d-71f4-4f39-b091-99dafa1dc8fe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1735 microversion: 2.1 time: 0.153780 May 23 17:22:16.539900 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 270/552] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:16 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:16.916454 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c117b79d-b63c-445d-a135-e6b78c9d157c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-878894821", "imageRef": "99870172-61a4-4218-9407-6a6da3fb5c83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "24a76815-79f9-4055-b7f1-41c72b5eca6c"}], "security_groups": [{"name": "tempest-securitygroup--1956304995"}], "key_name": "tempest-keypair-401533959", "user_data": "}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:22:16.935644 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3e3638a9-0774-4469-9832-85ea353920c4 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:16.936292 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3e3638a9-0774-4469-9832-85ea353920c4 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:16.942415 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3e3638a9-0774-4469-9832-85ea353920c4 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:16.942915 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3e3638a9-0774-4469-9832-85ea353920c4 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:16.943766 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3e3638a9-0774-4469-9832-85ea353920c4 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:16.944258 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3e3638a9-0774-4469-9832-85ea353920c4 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:17.061538 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.network.neutron [None req-c117b79d-b63c-445d-a135-e6b78c9d157c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] validate_networks() for [('24a76815-79f9-4055-b7f1-41c72b5eca6c', None, None, None, None, None)] {{(pid=117910) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 17:22:17.182429 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3e3638a9-0774-4469-9832-85ea353920c4 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:17.190908 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3e3638a9-0774-4469-9832-85ea353920c4 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1760 microversion: 2.1 time: 0.259516 May 23 17:22:17.200671 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 271/553] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:16 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1760 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:17.470034 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-c117b79d-b63c-445d-a135-e6b78c9d157c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Flavor limits 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 17:22:17.470661 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-c117b79d-b63c-445d-a135-e6b78c9d157c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Image limits 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 17:22:17.471224 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-c117b79d-b63c-445d-a135-e6b78c9d157c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Flavor pref 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 17:22:17.471682 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-c117b79d-b63c-445d-a135-e6b78c9d157c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Image pref 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 17:22:17.472255 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-c117b79d-b63c-445d-a135-e6b78c9d157c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 17:22:17.485216 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c117b79d-b63c-445d-a135-e6b78c9d157c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:17.485704 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c117b79d-b63c-445d-a135-e6b78c9d157c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:17.486509 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c117b79d-b63c-445d-a135-e6b78c9d157c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:17.486940 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c117b79d-b63c-445d-a135-e6b78c9d157c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:17.503457 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-c117b79d-b63c-445d-a135-e6b78c9d157c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Getting quotas for project 5724b98399214909a99dec90c2718c44. Resources: {'cores', 'instances', 'ram'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 17:22:17.507504 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-c117b79d-b63c-445d-a135-e6b78c9d157c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Getting quotas for user 8485b40daa3347d3a438c2006d9d4ef5 and project 5724b98399214909a99dec90c2718c44. Resources: {'cores', 'instances', 'ram'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 17:22:17.519904 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c117b79d-b63c-445d-a135-e6b78c9d157c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Going to run 1 instances... {{(pid=117910) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 17:22:17.522233 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c117b79d-b63c-445d-a135-e6b78c9d157c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99870172-61a4-4218-9407-6a6da3fb5c83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117910) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 17:22:17.560920 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-53894fb9-4cdc-42b5-9350-b21e21b9f6f0 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:17.561896 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-53894fb9-4cdc-42b5-9350-b21e21b9f6f0 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:17.570121 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-53894fb9-4cdc-42b5-9350-b21e21b9f6f0 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:17.570645 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-53894fb9-4cdc-42b5-9350-b21e21b9f6f0 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:17.571490 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-53894fb9-4cdc-42b5-9350-b21e21b9f6f0 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:17.572023 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-53894fb9-4cdc-42b5-9350-b21e21b9f6f0 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:17.578794 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c117b79d-b63c-445d-a135-e6b78c9d157c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.666683 May 23 17:22:17.579584 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 283/554] 10.222.0.46 () {62 vars in 1187 bytes} [Mon May 23 17:22:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 23 17:22:17.590390 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-245f03e0-de1c-4848-8f29-81900a395bfe tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:17.591071 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-245f03e0-de1c-4848-8f29-81900a395bfe tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:17.670690 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-245f03e0-de1c-4848-8f29-81900a395bfe tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:17.679624 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-245f03e0-de1c-4848-8f29-81900a395bfe tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:17.681217 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-245f03e0-de1c-4848-8f29-81900a395bfe tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:17.682435 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-245f03e0-de1c-4848-8f29-81900a395bfe tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1280 microversion: 2.20 time: 0.096116 May 23 17:22:17.682999 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 284/555] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:22:17 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1280 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:22:17.740148 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-53894fb9-4cdc-42b5-9350-b21e21b9f6f0 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:17.748405 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-53894fb9-4cdc-42b5-9350-b21e21b9f6f0 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1735 microversion: 2.1 time: 0.194643 May 23 17:22:17.748997 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 272/556] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:17 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1735 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:18.118872 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-7b7e10b0-a02e-4170-9adb-44e36913a4cd tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:18.119381 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-7b7e10b0-a02e-4170-9adb-44e36913a4cd tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 9ed3837e-0541-485a-9795-7aabaddcaec0] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:18.127841 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7b7e10b0-a02e-4170-9adb-44e36913a4cd tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:18.128316 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7b7e10b0-a02e-4170-9adb-44e36913a4cd tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:18.129110 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7b7e10b0-a02e-4170-9adb-44e36913a4cd tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:18.129545 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7b7e10b0-a02e-4170-9adb-44e36913a4cd tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:18.213936 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.objects.instance [None req-7b7e10b0-a02e-4170-9adb-44e36913a4cd tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lazy-loading 'services' on Instance uuid 9ed3837e-0541-485a-9795-7aabaddcaec0 {{(pid=117910) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 17:22:18.297353 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-7b7e10b0-a02e-4170-9adb-44e36913a4cd tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9ed3837e-0541-485a-9795-7aabaddcaec0/os-volume_attachments/28896e06-84b9-4134-af53-24dd34689437" status: 202 len: 0 microversion: 2.1 time: 0.182199 May 23 17:22:18.297939 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 285/557] 10.222.0.46 () {58 vars in 1415 bytes} [Mon May 23 17:22:18 2022] DELETE /compute/v2.1/servers/9ed3837e-0541-485a-9795-7aabaddcaec0/os-volume_attachments/28896e06-84b9-4134-af53-24dd34689437 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 17:22:18.700769 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7a7e1f01-393d-4176-868c-97b2b13c6ce7 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:18.701495 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7a7e1f01-393d-4176-868c-97b2b13c6ce7 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:18.719733 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7a7e1f01-393d-4176-868c-97b2b13c6ce7 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:18.720180 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7a7e1f01-393d-4176-868c-97b2b13c6ce7 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:18.721259 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7a7e1f01-393d-4176-868c-97b2b13c6ce7 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:18.721855 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7a7e1f01-393d-4176-868c-97b2b13c6ce7 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:18.766905 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-81b8e21c-d0da-4343-aee6-8882e35d3947 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:18.772433 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-81b8e21c-d0da-4343-aee6-8882e35d3947 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:18.780204 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-81b8e21c-d0da-4343-aee6-8882e35d3947 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:18.780978 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-81b8e21c-d0da-4343-aee6-8882e35d3947 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:18.781937 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-81b8e21c-d0da-4343-aee6-8882e35d3947 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:18.782532 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-81b8e21c-d0da-4343-aee6-8882e35d3947 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:18.794654 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7a7e1f01-393d-4176-868c-97b2b13c6ce7 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:18.804387 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7a7e1f01-393d-4176-868c-97b2b13c6ce7 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:18.805959 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7a7e1f01-393d-4176-868c-97b2b13c6ce7 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:18.807268 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7a7e1f01-393d-4176-868c-97b2b13c6ce7 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1276 microversion: 2.20 time: 0.110606 May 23 17:22:18.807822 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 273/558] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:22:18 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1276 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:22:19.162338 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-81b8e21c-d0da-4343-aee6-8882e35d3947 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:19.172319 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-81b8e21c-d0da-4343-aee6-8882e35d3947 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1715 microversion: 2.1 time: 0.410034 May 23 17:22:19.172918 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 286/559] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:18 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1715 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:19.291406 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4efe566a-7695-4e48-a7a9-1481f154b67e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:19.291903 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4efe566a-7695-4e48-a7a9-1481f154b67e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:19.298276 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4efe566a-7695-4e48-a7a9-1481f154b67e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:19.298721 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4efe566a-7695-4e48-a7a9-1481f154b67e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:19.299471 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4efe566a-7695-4e48-a7a9-1481f154b67e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:19.299895 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4efe566a-7695-4e48-a7a9-1481f154b67e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:19.433335 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-4efe566a-7695-4e48-a7a9-1481f154b67e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] HTTP exception thrown: Cannot 'detach_volume' instance c26b20b6-8a97-4aa1-af83-616cc09c9165 while it is in vm_state rescued May 23 17:22:19.435030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4efe566a-7695-4e48-a7a9-1481f154b67e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Request method failure captured: May 23 17:22:19.435030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: request: DELETE /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165/os-volume_attachments/82bf1310-3505-4c9d-b6c9-3e95f8371e04 HTTP/1.1 May 23 17:22:19.435030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept: application/json May 23 17:22:19.435030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity May 23 17:22:19.435030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Connection: close May 23 17:22:19.435030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Length: 0 May 23 17:22:19.435030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Type: application/json May 23 17:22:19.435030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Host: 10.222.0.46 May 23 17:22:19.435030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None May 23 17:22:19.435030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.9 May 23 17:22:19.435030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABii8HG0mgu4EO3OIfAaF2B3uvrt0HWl6redgiQ2amic5kI7hYTXFXsPdkkm5i1trVjfr7y7aQu40FrA_H1McTmt606JBABM6--n7E5dMGSGOv1HeOooMYCBiNeUywA0TG4sUNGbtPMRvIBMzMxwPFKuLlh0QtTh2yEErLoqKMT2s-W6-g May 23 17:22:19.435030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Id: None May 23 17:22:19.435030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Name: None May 23 17:22:19.435030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed May 23 17:22:19.435030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True May 23 17:22:19.435030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default May 23 17:22:19.435030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default May 23 17:22:19.435030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Id: 9b1709bec893431599352cb6e470cf76 May 23 17:22:19.435030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-407230310 May 23 17:22:19.435030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Role: reader,member May 23 17:22:19.435030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Roles: reader,member May 23 17:22:19.436566 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9b1709bec893431599352cb6e470cf76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9b1709bec893431599352cb6e470cf76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9b1709bec893431599352cb6e470cf76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9b1709bec893431599352cb6e470cf76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:22:19.436566 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-ServerRescueNegativeTestJSON-407230310 May 23 17:22:19.436566 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 9b1709bec893431599352cb6e470cf76 May 23 17:22:19.436566 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-407230310 May 23 17:22:19.436566 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User: tempest-ServerRescueNegativeTestJSON-407230310-project May 23 17:22:19.436566 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default May 23 17:22:19.436566 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default May 23 17:22:19.436566 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Id: 8c5d1f4f0bec40ad8e325f8f92739b4d May 23 17:22:19.436566 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-ServerRescueNegativeTestJSON-407230310-project May 23 17:22:19.436566 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: method: > May 23 17:22:19.436566 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: exception: Cannot 'detach_volume' instance c26b20b6-8a97-4aa1-af83-616cc09c9165 while it is in vm_state rescued May 23 17:22:19.437322 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: action_args: {'server_id': 'c26b20b6-8a97-4aa1-af83-616cc09c9165', 'id': '82bf1310-3505-4c9d-b6c9-3e95f8371e04'} May 23 17:22:19.437322 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:22:19.437322 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:22:19.437322 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 23 17:22:19.437322 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 23 17:22:19.437322 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 17:22:19.437322 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 17:22:19.437322 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 23 17:22:19.437322 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 23 17:22:19.437322 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c26b20b6-8a97-4aa1-af83-616cc09c9165 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 23 17:22:19.437322 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:22:19.437322 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:22:19.437322 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:22:19.437322 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:22:19.437322 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:22:19.437322 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:22:19.437322 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:22:19.437322 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:22:19.437322 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:22:19.437322 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:22:19.438669 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 23 17:22:19.438669 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 23 17:22:19.438669 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 23 17:22:19.438669 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 23 17:22:19.438669 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c26b20b6-8a97-4aa1-af83-616cc09c9165 while it is in vm_state rescued May 23 17:22:19.438669 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:22:19.438669 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:22:19.438669 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:22:19.438669 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:22:19.438669 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:22:19.438669 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:22:19.438669 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:22:19.438669 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:22:19.438669 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c26b20b6-8a97-4aa1-af83-616cc09c9165 while it is in vm_state rescued May 23 17:22:19.438669 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:22:19.438669 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4efe566a-7695-4e48-a7a9-1481f154b67e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Returning 409 to user: Cannot 'detach_volume' instance c26b20b6-8a97-4aa1-af83-616cc09c9165 while it is in vm_state rescued {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:22:19.439799 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4efe566a-7695-4e48-a7a9-1481f154b67e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165/os-volume_attachments/82bf1310-3505-4c9d-b6c9-3e95f8371e04" status: 409 len: 152 microversion: 2.1 time: 0.149033 May 23 17:22:19.439799 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 274/560] 10.222.0.46 () {58 vars in 1415 bytes} [Mon May 23 17:22:19 2022] DELETE /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165/os-volume_attachments/82bf1310-3505-4c9d-b6c9-3e95f8371e04 => generated 152 bytes in 150 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 23 17:22:19.445788 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-437990db-7918-4faa-acd7-3728954b911f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:22:19.446318 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-437990db-7918-4faa-acd7-3728954b911f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:19.452464 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-437990db-7918-4faa-acd7-3728954b911f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:19.452966 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-437990db-7918-4faa-acd7-3728954b911f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:19.454133 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-437990db-7918-4faa-acd7-3728954b911f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:19.454570 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-437990db-7918-4faa-acd7-3728954b911f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:19.526353 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-437990db-7918-4faa-acd7-3728954b911f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "POST /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165/action" status: 202 len: 0 microversion: 2.1 time: 0.084339 May 23 17:22:19.527650 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 287/561] 10.222.0.46 () {60 vars in 1277 bytes} [Mon May 23 17:22:19 2022] POST /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 17:22:19.536721 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3f636c7e-1c55-4b3f-8263-92c2c015eabe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:19.537484 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3f636c7e-1c55-4b3f-8263-92c2c015eabe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:19.545229 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3f636c7e-1c55-4b3f-8263-92c2c015eabe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:19.545924 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3f636c7e-1c55-4b3f-8263-92c2c015eabe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:19.546934 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3f636c7e-1c55-4b3f-8263-92c2c015eabe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:19.547859 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3f636c7e-1c55-4b3f-8263-92c2c015eabe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:19.745090 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3f636c7e-1c55-4b3f-8263-92c2c015eabe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:19.756100 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3f636c7e-1c55-4b3f-8263-92c2c015eabe tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1723 microversion: 2.1 time: 0.224378 May 23 17:22:19.758227 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 275/562] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:19 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:19.829533 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-20263148-03ec-4bf4-ab1d-3a191ce011a1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:19.830620 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-20263148-03ec-4bf4-ab1d-3a191ce011a1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:19.842592 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-20263148-03ec-4bf4-ab1d-3a191ce011a1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:19.843050 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-20263148-03ec-4bf4-ab1d-3a191ce011a1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:19.843842 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-20263148-03ec-4bf4-ab1d-3a191ce011a1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:19.844293 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-20263148-03ec-4bf4-ab1d-3a191ce011a1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:19.917788 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-20263148-03ec-4bf4-ab1d-3a191ce011a1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:19.926094 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-20263148-03ec-4bf4-ab1d-3a191ce011a1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:19.927609 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-20263148-03ec-4bf4-ab1d-3a191ce011a1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:19.928762 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-20263148-03ec-4bf4-ab1d-3a191ce011a1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1338 microversion: 2.20 time: 0.106370 May 23 17:22:19.929389 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 288/563] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:22:19 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1338 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:22:20.476471 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c998cfe1-a577-4f70-a079-fcd0512c5c6a tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:20.476991 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c998cfe1-a577-4f70-a079-fcd0512c5c6a tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 9ed3837e-0541-485a-9795-7aabaddcaec0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:20.483561 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c998cfe1-a577-4f70-a079-fcd0512c5c6a tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:20.484045 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c998cfe1-a577-4f70-a079-fcd0512c5c6a tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:20.484833 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c998cfe1-a577-4f70-a079-fcd0512c5c6a tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:20.485268 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c998cfe1-a577-4f70-a079-fcd0512c5c6a tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:20.505451 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:22:20.514285 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c998cfe1-a577-4f70-a079-fcd0512c5c6a tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 9ed3837e-0541-485a-9795-7aabaddcaec0] Going to try to terminate instance {{(pid=117909) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 17:22:20.595575 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c998cfe1-a577-4f70-a079-fcd0512c5c6a tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9ed3837e-0541-485a-9795-7aabaddcaec0" status: 204 len: 0 microversion: 2.1 time: 0.122668 May 23 17:22:20.596175 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 276/564] 10.222.0.46 () {58 vars in 1238 bytes} [Mon May 23 17:22:20 2022] DELETE /compute/v2.1/servers/9ed3837e-0541-485a-9795-7aabaddcaec0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 17:22:20.604441 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-48d0e1cb-3559-41e4-b1b9-2f4b192c4cbe tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:20.605089 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-48d0e1cb-3559-41e4-b1b9-2f4b192c4cbe tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 9ed3837e-0541-485a-9795-7aabaddcaec0] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:20.611885 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-48d0e1cb-3559-41e4-b1b9-2f4b192c4cbe tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:20.612332 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-48d0e1cb-3559-41e4-b1b9-2f4b192c4cbe tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:20.613132 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-48d0e1cb-3559-41e4-b1b9-2f4b192c4cbe tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:20.613571 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-48d0e1cb-3559-41e4-b1b9-2f4b192c4cbe tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:20.743494 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-48d0e1cb-3559-41e4-b1b9-2f4b192c4cbe tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:20.751018 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-48d0e1cb-3559-41e4-b1b9-2f4b192c4cbe tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/9ed3837e-0541-485a-9795-7aabaddcaec0" status: 200 len: 1514 microversion: 2.1 time: 0.150470 May 23 17:22:20.751585 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 289/565] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:20 2022] GET /compute/v2.1/servers/9ed3837e-0541-485a-9795-7aabaddcaec0 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:20.776002 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3ff59aee-6d12-465a-a0f7-b76274594ee2 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:20.776741 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3ff59aee-6d12-465a-a0f7-b76274594ee2 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:20.783855 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3ff59aee-6d12-465a-a0f7-b76274594ee2 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:20.784316 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3ff59aee-6d12-465a-a0f7-b76274594ee2 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:20.785118 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3ff59aee-6d12-465a-a0f7-b76274594ee2 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:20.785560 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3ff59aee-6d12-465a-a0f7-b76274594ee2 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:20.923525 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3ff59aee-6d12-465a-a0f7-b76274594ee2 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:20.931949 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3ff59aee-6d12-465a-a0f7-b76274594ee2 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1723 microversion: 2.1 time: 0.160336 May 23 17:22:20.932525 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 277/566] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:20 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:20.947159 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-92e479ad-3847-4e1f-b10f-c8bd9117b6a3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:20.947702 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-92e479ad-3847-4e1f-b10f-c8bd9117b6a3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:20.954088 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-92e479ad-3847-4e1f-b10f-c8bd9117b6a3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:20.954570 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-92e479ad-3847-4e1f-b10f-c8bd9117b6a3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:20.955327 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-92e479ad-3847-4e1f-b10f-c8bd9117b6a3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:20.955760 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-92e479ad-3847-4e1f-b10f-c8bd9117b6a3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:21.089757 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-92e479ad-3847-4e1f-b10f-c8bd9117b6a3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:21.098234 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-92e479ad-3847-4e1f-b10f-c8bd9117b6a3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:21.099776 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-92e479ad-3847-4e1f-b10f-c8bd9117b6a3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:21.100947 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-92e479ad-3847-4e1f-b10f-c8bd9117b6a3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1406 microversion: 2.20 time: 0.157732 May 23 17:22:21.101640 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 290/567] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:22:20 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:22:21.768427 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8986ed3c-48c5-42c6-8c49-da2ae05219a1 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:21.769070 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8986ed3c-48c5-42c6-8c49-da2ae05219a1 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 9ed3837e-0541-485a-9795-7aabaddcaec0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:21.775532 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8986ed3c-48c5-42c6-8c49-da2ae05219a1 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:21.775978 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8986ed3c-48c5-42c6-8c49-da2ae05219a1 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:21.776860 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8986ed3c-48c5-42c6-8c49-da2ae05219a1 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:21.777597 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8986ed3c-48c5-42c6-8c49-da2ae05219a1 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:21.949280 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-cb5f4949-803a-4234-9d81-9f90b0e196be tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:21.951030 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-cb5f4949-803a-4234-9d81-9f90b0e196be tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:21.958878 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cb5f4949-803a-4234-9d81-9f90b0e196be tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:21.959497 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cb5f4949-803a-4234-9d81-9f90b0e196be tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:21.960281 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cb5f4949-803a-4234-9d81-9f90b0e196be tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:21.960729 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cb5f4949-803a-4234-9d81-9f90b0e196be tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:22.007682 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8986ed3c-48c5-42c6-8c49-da2ae05219a1 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:22.015950 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8986ed3c-48c5-42c6-8c49-da2ae05219a1 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/9ed3837e-0541-485a-9795-7aabaddcaec0" status: 200 len: 1514 microversion: 2.1 time: 0.251469 May 23 17:22:22.016494 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 278/568] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:21 2022] GET /compute/v2.1/servers/9ed3837e-0541-485a-9795-7aabaddcaec0 => generated 1514 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:22.119512 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b946fd30-f170-4ebe-acac-55bda8c21be7 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:22.120326 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b946fd30-f170-4ebe-acac-55bda8c21be7 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:22.126979 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b946fd30-f170-4ebe-acac-55bda8c21be7 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:22.127432 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b946fd30-f170-4ebe-acac-55bda8c21be7 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:22.128204 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b946fd30-f170-4ebe-acac-55bda8c21be7 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:22.128645 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b946fd30-f170-4ebe-acac-55bda8c21be7 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:22.166199 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-cb5f4949-803a-4234-9d81-9f90b0e196be tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:22.176141 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-cb5f4949-803a-4234-9d81-9f90b0e196be tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1723 microversion: 2.1 time: 0.230717 May 23 17:22:22.176751 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 291/569] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:21 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:22.359703 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b946fd30-f170-4ebe-acac-55bda8c21be7 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:22.372004 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b946fd30-f170-4ebe-acac-55bda8c21be7 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:22.373569 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b946fd30-f170-4ebe-acac-55bda8c21be7 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:22.375185 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b946fd30-f170-4ebe-acac-55bda8c21be7 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1406 microversion: 2.20 time: 0.259918 May 23 17:22:22.375908 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 279/570] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:22:22 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1406 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:22:22.529656 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-4d2cc797-2a1a-452d-ba62-1d8db31013e2 req-64f29855-76a3-46a3-bb92-14de9080b023 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "549b0d88-0258-406c-90f1-fe4af4916e98", "tag": "d71c640f-947d-49b7-9fa5-19acd7e88bcb"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:22:22.538537 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-4d2cc797-2a1a-452d-ba62-1d8db31013e2 req-64f29855-76a3-46a3-bb92-14de9080b023 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:22.539063 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-4d2cc797-2a1a-452d-ba62-1d8db31013e2 req-64f29855-76a3-46a3-bb92-14de9080b023 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:22.551667 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-4d2cc797-2a1a-452d-ba62-1d8db31013e2 req-64f29855-76a3-46a3-bb92-14de9080b023 service nova] Creating event network-changed:d71c640f-947d-49b7-9fa5-19acd7e88bcb for instance 549b0d88-0258-406c-90f1-fe4af4916e98 on hv-cinder-84299 May 23 17:22:22.557102 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-4d2cc797-2a1a-452d-ba62-1d8db31013e2 req-64f29855-76a3-46a3-bb92-14de9080b023 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031242 May 23 17:22:22.557732 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 292/571] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:22:23.037337 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9c90fa11-6b50-4796-a0e2-3f68a71655b6 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:23.039081 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9c90fa11-6b50-4796-a0e2-3f68a71655b6 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 9ed3837e-0541-485a-9795-7aabaddcaec0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:23.050460 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9c90fa11-6b50-4796-a0e2-3f68a71655b6 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:23.051033 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9c90fa11-6b50-4796-a0e2-3f68a71655b6 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:23.052297 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9c90fa11-6b50-4796-a0e2-3f68a71655b6 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:23.053076 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9c90fa11-6b50-4796-a0e2-3f68a71655b6 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:23.192471 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9c90fa11-6b50-4796-a0e2-3f68a71655b6 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:23.194274 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-0b264f93-07fb-400f-a7b9-ff59ec1a6153 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:23.194976 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-0b264f93-07fb-400f-a7b9-ff59ec1a6153 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:23.200343 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9c90fa11-6b50-4796-a0e2-3f68a71655b6 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/9ed3837e-0541-485a-9795-7aabaddcaec0" status: 200 len: 1514 microversion: 2.1 time: 0.169526 May 23 17:22:23.201113 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 280/572] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:23 2022] GET /compute/v2.1/servers/9ed3837e-0541-485a-9795-7aabaddcaec0 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:23.202292 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0b264f93-07fb-400f-a7b9-ff59ec1a6153 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:23.202735 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0b264f93-07fb-400f-a7b9-ff59ec1a6153 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:23.203515 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0b264f93-07fb-400f-a7b9-ff59ec1a6153 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:23.203946 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0b264f93-07fb-400f-a7b9-ff59ec1a6153 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:23.222263 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:22:23.350389 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-0b264f93-07fb-400f-a7b9-ff59ec1a6153 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:23.358570 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-0b264f93-07fb-400f-a7b9-ff59ec1a6153 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1729 microversion: 2.1 time: 0.168604 May 23 17:22:23.359142 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 293/573] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:23 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:23.378269 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a0babe9b-3961-4df1-b189-fe197bb18782 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:23.378889 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a0babe9b-3961-4df1-b189-fe197bb18782 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:23.388127 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a0babe9b-3961-4df1-b189-fe197bb18782 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:23.388574 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a0babe9b-3961-4df1-b189-fe197bb18782 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:23.389381 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a0babe9b-3961-4df1-b189-fe197bb18782 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:23.389806 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a0babe9b-3961-4df1-b189-fe197bb18782 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:23.393741 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-fcd200d5-1295-4f65-a302-2103d1ccd9be tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:23.394434 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-fcd200d5-1295-4f65-a302-2103d1ccd9be tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:23.400574 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fcd200d5-1295-4f65-a302-2103d1ccd9be tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:23.401074 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fcd200d5-1295-4f65-a302-2103d1ccd9be tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:23.401833 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fcd200d5-1295-4f65-a302-2103d1ccd9be tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:23.402332 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fcd200d5-1295-4f65-a302-2103d1ccd9be tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:23.489798 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a0babe9b-3961-4df1-b189-fe197bb18782 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.118022 May 23 17:22:23.490398 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 281/574] 10.222.0.46 () {58 vars in 1274 bytes} [Mon May 23 17:22:23 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 17:22:23.554196 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-fcd200d5-1295-4f65-a302-2103d1ccd9be tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:23.562100 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-fcd200d5-1295-4f65-a302-2103d1ccd9be tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:23.563595 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-fcd200d5-1295-4f65-a302-2103d1ccd9be tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:23.564689 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-fcd200d5-1295-4f65-a302-2103d1ccd9be tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1406 microversion: 2.20 time: 0.174855 May 23 17:22:23.565284 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 294/575] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:22:23 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:22:24.220674 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d0626b0b-3c6c-4cfa-9959-53493e6cfecc tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:24.221282 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d0626b0b-3c6c-4cfa-9959-53493e6cfecc tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 9ed3837e-0541-485a-9795-7aabaddcaec0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:24.229511 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d0626b0b-3c6c-4cfa-9959-53493e6cfecc tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:24.229962 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d0626b0b-3c6c-4cfa-9959-53493e6cfecc tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:24.230879 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d0626b0b-3c6c-4cfa-9959-53493e6cfecc tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:24.231459 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d0626b0b-3c6c-4cfa-9959-53493e6cfecc tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:24.403929 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d0626b0b-3c6c-4cfa-9959-53493e6cfecc tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:24.411580 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d0626b0b-3c6c-4cfa-9959-53493e6cfecc tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/9ed3837e-0541-485a-9795-7aabaddcaec0" status: 200 len: 1514 microversion: 2.1 time: 0.197320 May 23 17:22:24.412230 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 282/576] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:24 2022] GET /compute/v2.1/servers/9ed3837e-0541-485a-9795-7aabaddcaec0 => generated 1514 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:24.583137 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-6dad657e-3ff6-4ff5-8c10-5869cc05bbd6 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:24.583757 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-6dad657e-3ff6-4ff5-8c10-5869cc05bbd6 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:24.593054 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6dad657e-3ff6-4ff5-8c10-5869cc05bbd6 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:24.593506 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6dad657e-3ff6-4ff5-8c10-5869cc05bbd6 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:24.594295 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6dad657e-3ff6-4ff5-8c10-5869cc05bbd6 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:24.594734 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6dad657e-3ff6-4ff5-8c10-5869cc05bbd6 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:24.734814 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-6dad657e-3ff6-4ff5-8c10-5869cc05bbd6 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:24.743128 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-6dad657e-3ff6-4ff5-8c10-5869cc05bbd6 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:24.744716 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-6dad657e-3ff6-4ff5-8c10-5869cc05bbd6 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:24.745786 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-6dad657e-3ff6-4ff5-8c10-5869cc05bbd6 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1406 microversion: 2.20 time: 0.166997 May 23 17:22:24.746447 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 295/577] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:22:24 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:22:24.797542 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-c6860b32-cd2b-4d5d-95e3-7672ae0f1773 req-cbec4c3b-b97e-442a-b787-45934bfafcbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ed3837e-0541-485a-9795-7aabaddcaec0", "name": "network-vif-deleted", "tag": "242c4270-3339-4f03-8f19-49fbcc9ed6f4"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:22:24.805144 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-c6860b32-cd2b-4d5d-95e3-7672ae0f1773 req-cbec4c3b-b97e-442a-b787-45934bfafcbe service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:24.805582 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-c6860b32-cd2b-4d5d-95e3-7672ae0f1773 req-cbec4c3b-b97e-442a-b787-45934bfafcbe service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:24.817830 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-c6860b32-cd2b-4d5d-95e3-7672ae0f1773 req-cbec4c3b-b97e-442a-b787-45934bfafcbe service nova] Creating event network-vif-deleted:242c4270-3339-4f03-8f19-49fbcc9ed6f4 for instance 9ed3837e-0541-485a-9795-7aabaddcaec0 on hv-cinder-84299 May 23 17:22:24.823464 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-c6860b32-cd2b-4d5d-95e3-7672ae0f1773 req-cbec4c3b-b97e-442a-b787-45934bfafcbe service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032008 May 23 17:22:24.824322 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 283/578] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:22:25.429609 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-60260463-2649-42b8-b71e-ce7f00d36d92 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:25.430309 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-60260463-2649-42b8-b71e-ce7f00d36d92 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 9ed3837e-0541-485a-9795-7aabaddcaec0] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:25.436934 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-60260463-2649-42b8-b71e-ce7f00d36d92 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:25.437384 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-60260463-2649-42b8-b71e-ce7f00d36d92 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:25.438144 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-60260463-2649-42b8-b71e-ce7f00d36d92 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:25.438573 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-60260463-2649-42b8-b71e-ce7f00d36d92 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:25.469538 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-60260463-2649-42b8-b71e-ce7f00d36d92 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:25.470016 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-60260463-2649-42b8-b71e-ce7f00d36d92 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:25.470466 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.objects.instance [None req-60260463-2649-42b8-b71e-ce7f00d36d92 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lazy-loading 'fault' on Instance uuid 9ed3837e-0541-485a-9795-7aabaddcaec0 {{(pid=117910) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 17:22:25.510757 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-60260463-2649-42b8-b71e-ce7f00d36d92 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c25a40827e4737a7ae823dee8615be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19de3d45e12e40a9949c91c7f1cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:25.518764 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-60260463-2649-42b8-b71e-ce7f00d36d92 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/9ed3837e-0541-485a-9795-7aabaddcaec0" status: 200 len: 1309 microversion: 2.1 time: 0.093200 May 23 17:22:25.519338 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 296/579] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:25 2022] GET /compute/v2.1/servers/9ed3837e-0541-485a-9795-7aabaddcaec0 => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:25.764703 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ee97863b-ff7a-416f-8af0-9b05098bb997 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:25.765417 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ee97863b-ff7a-416f-8af0-9b05098bb997 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:25.768120 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=4 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:22:25.774160 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ee97863b-ff7a-416f-8af0-9b05098bb997 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:25.774616 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ee97863b-ff7a-416f-8af0-9b05098bb997 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:25.775422 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ee97863b-ff7a-416f-8af0-9b05098bb997 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:25.775897 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ee97863b-ff7a-416f-8af0-9b05098bb997 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:25.909150 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ee97863b-ff7a-416f-8af0-9b05098bb997 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:25.917458 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ee97863b-ff7a-416f-8af0-9b05098bb997 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:25.919067 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ee97863b-ff7a-416f-8af0-9b05098bb997 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:25.920182 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ee97863b-ff7a-416f-8af0-9b05098bb997 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1406 microversion: 2.20 time: 0.160364 May 23 17:22:25.920785 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 284/580] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:22:25 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:22:26.539724 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e1ecb189-2cb2-49f5-95cf-8371dfc21841 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:26.540591 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-e1ecb189-2cb2-49f5-95cf-8371dfc21841 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] [instance: 9ed3837e-0541-485a-9795-7aabaddcaec0] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:26.548786 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e1ecb189-2cb2-49f5-95cf-8371dfc21841 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:26.549235 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e1ecb189-2cb2-49f5-95cf-8371dfc21841 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:26.550005 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e1ecb189-2cb2-49f5-95cf-8371dfc21841 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:26.550442 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e1ecb189-2cb2-49f5-95cf-8371dfc21841 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:26.564130 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-e1ecb189-2cb2-49f5-95cf-8371dfc21841 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] HTTP exception thrown: Instance 9ed3837e-0541-485a-9795-7aabaddcaec0 could not be found. May 23 17:22:26.565818 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e1ecb189-2cb2-49f5-95cf-8371dfc21841 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Request method failure captured: May 23 17:22:26.565818 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: request: GET /compute/v2.1/servers/9ed3837e-0541-485a-9795-7aabaddcaec0 HTTP/1.1 May 23 17:22:26.565818 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept: application/json May 23 17:22:26.565818 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity May 23 17:22:26.565818 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Connection: close May 23 17:22:26.565818 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Length: 0 May 23 17:22:26.565818 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Type: application/json May 23 17:22:26.565818 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Host: 10.222.0.46 May 23 17:22:26.565818 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None May 23 17:22:26.565818 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.9 May 23 17:22:26.565818 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABii8I4LZLM5U8o-SdUCjW7spYaCQ4ouMICHcauAIeSCyYU2ZlWbuLtmTC7QcvOLcf_v-jCcJnbNUXWjI4wvExOfmnZMnPuTtGygpwuz9stNBGMJjsiR1p3uaIv7gNaEb6CJWurhJaekMcnSZAvYpj00ZTtdYJy9qH81FWkKTZT5OWOdbY May 23 17:22:26.565818 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Id: None May 23 17:22:26.565818 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Name: None May 23 17:22:26.565818 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed May 23 17:22:26.565818 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True May 23 17:22:26.565818 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default May 23 17:22:26.565818 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default May 23 17:22:26.565818 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Id: 19de3d45e12e40a9949c91c7f1cd4fe3 May 23 17:22:26.565818 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1736113026 May 23 17:22:26.565818 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Role: reader,member May 23 17:22:26.565818 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Roles: reader,member May 23 17:22:26.567271 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/19de3d45e12e40a9949c91c7f1cd4fe3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/19de3d45e12e40a9949c91c7f1cd4fe3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/19de3d45e12e40a9949c91c7f1cd4fe3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_19de3d45e12e40a9949c91c7f1cd4fe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:22:26.567271 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-VolumesSnapshotTestJSON-1736113026 May 23 17:22:26.567271 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 19de3d45e12e40a9949c91c7f1cd4fe3 May 23 17:22:26.567271 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1736113026 May 23 17:22:26.567271 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User: tempest-VolumesSnapshotTestJSON-1736113026-project May 23 17:22:26.567271 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default May 23 17:22:26.567271 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default May 23 17:22:26.567271 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Id: 25c25a40827e4737a7ae823dee8615be May 23 17:22:26.567271 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-VolumesSnapshotTestJSON-1736113026-project May 23 17:22:26.567271 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: method: > May 23 17:22:26.567271 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: exception: Instance 9ed3837e-0541-485a-9795-7aabaddcaec0 could not be found. May 23 17:22:26.567271 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: action_args: {'id': '9ed3837e-0541-485a-9795-7aabaddcaec0'} May 23 17:22:26.568085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:22:26.568085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:22:26.568085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:22:26.568085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:22:26.568085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:22:26.568085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:22:26.568085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:22:26.568085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:22:26.568085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:22:26.568085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:22:26.568085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ed3837e-0541-485a-9795-7aabaddcaec0 could not be found. May 23 17:22:26.568085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:22:26.568085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:22:26.568085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:22:26.568085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:22:26.568085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:22:26.568085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:22:26.568085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:22:26.568085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:22:26.568085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:22:26.569464 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:22:26.569464 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 17:22:26.569464 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 17:22:26.569464 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:22:26.569464 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:22:26.569464 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:22:26.569464 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:22:26.569464 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ed3837e-0541-485a-9795-7aabaddcaec0 could not be found. May 23 17:22:26.569464 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:22:26.569464 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:22:26.569464 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:22:26.569464 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:22:26.569464 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:22:26.569464 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:22:26.569464 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:22:26.569464 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:22:26.569464 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ed3837e-0541-485a-9795-7aabaddcaec0 could not be found. May 23 17:22:26.569464 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:22:26.570705 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e1ecb189-2cb2-49f5-95cf-8371dfc21841 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] Returning 404 to user: Instance 9ed3837e-0541-485a-9795-7aabaddcaec0 could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:22:26.570705 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-e1ecb189-2cb2-49f5-95cf-8371dfc21841 tempest-VolumesSnapshotTestJSON-1736113026 tempest-VolumesSnapshotTestJSON-1736113026-project] 10.222.0.46 "GET /compute/v2.1/servers/9ed3837e-0541-485a-9795-7aabaddcaec0" status: 404 len: 111 microversion: 2.1 time: 0.034223 May 23 17:22:26.570705 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 297/581] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:26 2022] GET /compute/v2.1/servers/9ed3837e-0541-485a-9795-7aabaddcaec0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:22:26.840238 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-6e9e859d-e76b-4370-a750-95a7aba95559 req-38b74e0c-387d-45c5-8a78-bce484cf8191 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c26b20b6-8a97-4aa1-af83-616cc09c9165", "tag": "b66d0e22-835b-4627-b12b-de1e251bd6e9"}, {"name": "network-changed", "server_uuid": "c26b20b6-8a97-4aa1-af83-616cc09c9165", "tag": "b66d0e22-835b-4627-b12b-de1e251bd6e9"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:22:26.849676 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-6e9e859d-e76b-4370-a750-95a7aba95559 req-38b74e0c-387d-45c5-8a78-bce484cf8191 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:26.850205 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-6e9e859d-e76b-4370-a750-95a7aba95559 req-38b74e0c-387d-45c5-8a78-bce484cf8191 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:26.862316 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-6e9e859d-e76b-4370-a750-95a7aba95559 req-38b74e0c-387d-45c5-8a78-bce484cf8191 service nova] Creating event network-changed:b66d0e22-835b-4627-b12b-de1e251bd6e9 for instance c26b20b6-8a97-4aa1-af83-616cc09c9165 on hv-cinder-84299 May 23 17:22:26.862893 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-6e9e859d-e76b-4370-a750-95a7aba95559 req-38b74e0c-387d-45c5-8a78-bce484cf8191 service nova] Creating event network-changed:b66d0e22-835b-4627-b12b-de1e251bd6e9 for instance c26b20b6-8a97-4aa1-af83-616cc09c9165 on hv-cinder-84299 May 23 17:22:26.868135 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-6e9e859d-e76b-4370-a750-95a7aba95559 req-38b74e0c-387d-45c5-8a78-bce484cf8191 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.031898 May 23 17:22:26.869035 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 285/582] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:22:26.938071 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-50c350fa-abe2-49c5-93d7-3ccc0b7c5d85 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:26.938688 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-50c350fa-abe2-49c5-93d7-3ccc0b7c5d85 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:26.944787 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-50c350fa-abe2-49c5-93d7-3ccc0b7c5d85 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:26.945307 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-50c350fa-abe2-49c5-93d7-3ccc0b7c5d85 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:26.946007 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-50c350fa-abe2-49c5-93d7-3ccc0b7c5d85 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:26.946425 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-50c350fa-abe2-49c5-93d7-3ccc0b7c5d85 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:27.081939 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-50c350fa-abe2-49c5-93d7-3ccc0b7c5d85 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:27.090789 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-50c350fa-abe2-49c5-93d7-3ccc0b7c5d85 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:27.092290 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-50c350fa-abe2-49c5-93d7-3ccc0b7c5d85 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:27.093419 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-50c350fa-abe2-49c5-93d7-3ccc0b7c5d85 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1406 microversion: 2.20 time: 0.159355 May 23 17:22:27.093973 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 298/583] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:22:26 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:22:28.113003 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ad672305-051d-46d1-beb2-004de2345323 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:28.113785 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ad672305-051d-46d1-beb2-004de2345323 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:28.119984 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ad672305-051d-46d1-beb2-004de2345323 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:28.120435 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ad672305-051d-46d1-beb2-004de2345323 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:28.121229 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ad672305-051d-46d1-beb2-004de2345323 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:28.121662 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ad672305-051d-46d1-beb2-004de2345323 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:28.274010 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ad672305-051d-46d1-beb2-004de2345323 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:28.283189 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ad672305-051d-46d1-beb2-004de2345323 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:28.284723 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ad672305-051d-46d1-beb2-004de2345323 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:28.285830 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ad672305-051d-46d1-beb2-004de2345323 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1406 microversion: 2.20 time: 0.177689 May 23 17:22:28.286410 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 286/584] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:22:28 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:22:29.307999 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2099bf06-d987-45a6-a7ca-5f117f695825 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:29.309050 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2099bf06-d987-45a6-a7ca-5f117f695825 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:29.311938 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=2 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:22:29.313848 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=8 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:22:29.323761 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2099bf06-d987-45a6-a7ca-5f117f695825 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:29.324412 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2099bf06-d987-45a6-a7ca-5f117f695825 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:29.325212 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2099bf06-d987-45a6-a7ca-5f117f695825 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:29.325656 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2099bf06-d987-45a6-a7ca-5f117f695825 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:29.464058 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2099bf06-d987-45a6-a7ca-5f117f695825 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:29.472583 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2099bf06-d987-45a6-a7ca-5f117f695825 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:29.474157 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2099bf06-d987-45a6-a7ca-5f117f695825 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:29.475268 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2099bf06-d987-45a6-a7ca-5f117f695825 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1406 microversion: 2.20 time: 0.173995 May 23 17:22:29.475832 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 299/585] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:22:29 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:22:30.494223 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-aa6e3ec7-c569-4bc4-9bbb-22768302c363 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:30.494820 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-aa6e3ec7-c569-4bc4-9bbb-22768302c363 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:30.502101 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aa6e3ec7-c569-4bc4-9bbb-22768302c363 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:30.502551 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aa6e3ec7-c569-4bc4-9bbb-22768302c363 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:30.503342 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aa6e3ec7-c569-4bc4-9bbb-22768302c363 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:30.503773 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aa6e3ec7-c569-4bc4-9bbb-22768302c363 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:30.634370 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-aa6e3ec7-c569-4bc4-9bbb-22768302c363 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:30.646639 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-aa6e3ec7-c569-4bc4-9bbb-22768302c363 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:30.649142 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-aa6e3ec7-c569-4bc4-9bbb-22768302c363 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:30.650818 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-aa6e3ec7-c569-4bc4-9bbb-22768302c363 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1406 microversion: 2.20 time: 0.160749 May 23 17:22:30.651612 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 287/586] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:22:30 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:22:31.430717 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-3f5735e5-f0ac-4e60-a30d-d1df64d0e41b req-5e756448-0348-4b31-a3a3-cc7ae1fef5cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "549b0d88-0258-406c-90f1-fe4af4916e98", "name": "network-vif-plugged", "status": "completed", "tag": "d71c640f-947d-49b7-9fa5-19acd7e88bcb"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:22:31.444153 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-3f5735e5-f0ac-4e60-a30d-d1df64d0e41b req-5e756448-0348-4b31-a3a3-cc7ae1fef5cf service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:31.444965 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-3f5735e5-f0ac-4e60-a30d-d1df64d0e41b req-5e756448-0348-4b31-a3a3-cc7ae1fef5cf service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:31.458850 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-3f5735e5-f0ac-4e60-a30d-d1df64d0e41b req-5e756448-0348-4b31-a3a3-cc7ae1fef5cf service nova] Creating event network-vif-plugged:d71c640f-947d-49b7-9fa5-19acd7e88bcb for instance 549b0d88-0258-406c-90f1-fe4af4916e98 on hv-cinder-84299 May 23 17:22:31.464271 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-3f5735e5-f0ac-4e60-a30d-d1df64d0e41b req-5e756448-0348-4b31-a3a3-cc7ae1fef5cf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037648 May 23 17:22:31.465578 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 300/587] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:22:31.669640 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-029d42d3-91f5-4ee6-a66e-82cbf13afb7e tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:31.670263 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-029d42d3-91f5-4ee6-a66e-82cbf13afb7e tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:31.677535 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-029d42d3-91f5-4ee6-a66e-82cbf13afb7e tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:31.677985 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-029d42d3-91f5-4ee6-a66e-82cbf13afb7e tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:31.678776 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-029d42d3-91f5-4ee6-a66e-82cbf13afb7e tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:31.679210 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-029d42d3-91f5-4ee6-a66e-82cbf13afb7e tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:31.815243 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-029d42d3-91f5-4ee6-a66e-82cbf13afb7e tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:31.823746 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-029d42d3-91f5-4ee6-a66e-82cbf13afb7e tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:31.825436 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-029d42d3-91f5-4ee6-a66e-82cbf13afb7e tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:31.826558 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-029d42d3-91f5-4ee6-a66e-82cbf13afb7e tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1406 microversion: 2.20 time: 0.161179 May 23 17:22:31.827128 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 288/588] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:22:31 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:22:31.968234 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-29941a24-45c2-422a-ae7d-c6356b2e4d4f tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:31.968844 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-29941a24-45c2-422a-ae7d-c6356b2e4d4f tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2391a78f-53ee-4e0f-b59f-5978e3ee93a0] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:31.976955 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-29941a24-45c2-422a-ae7d-c6356b2e4d4f tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:31.977476 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-29941a24-45c2-422a-ae7d-c6356b2e4d4f tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:31.979073 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-29941a24-45c2-422a-ae7d-c6356b2e4d4f tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:31.979517 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-29941a24-45c2-422a-ae7d-c6356b2e4d4f tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:32.003906 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-29941a24-45c2-422a-ae7d-c6356b2e4d4f tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2391a78f-53ee-4e0f-b59f-5978e3ee93a0] Going to try to terminate instance {{(pid=117910) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 17:22:32.073100 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:22:32.089677 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-29941a24-45c2-422a-ae7d-c6356b2e4d4f tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0" status: 204 len: 0 microversion: 2.1 time: 0.127058 May 23 17:22:32.090909 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 301/589] 10.222.0.46 () {58 vars in 1238 bytes} [Mon May 23 17:22:31 2022] DELETE /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 17:22:32.099149 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e606e95c-a4c1-40da-929b-f11153c00eae tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:32.099798 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e606e95c-a4c1-40da-929b-f11153c00eae tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2391a78f-53ee-4e0f-b59f-5978e3ee93a0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:32.105991 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e606e95c-a4c1-40da-929b-f11153c00eae tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:32.106481 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e606e95c-a4c1-40da-929b-f11153c00eae tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:32.107280 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e606e95c-a4c1-40da-929b-f11153c00eae tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:32.107713 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e606e95c-a4c1-40da-929b-f11153c00eae tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:32.238817 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e606e95c-a4c1-40da-929b-f11153c00eae tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:32.246668 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e606e95c-a4c1-40da-929b-f11153c00eae tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0" status: 200 len: 1574 microversion: 2.1 time: 0.151389 May 23 17:22:32.247244 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 289/590] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:32 2022] GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:32.460278 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 17:22:32.461288 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Mon May 23 17:22:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 17:22:32.845379 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-17b74353-496e-46a7-8ea2-584a0e4b0044 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:32.846071 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-17b74353-496e-46a7-8ea2-584a0e4b0044 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:32.855336 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-17b74353-496e-46a7-8ea2-584a0e4b0044 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:32.855783 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-17b74353-496e-46a7-8ea2-584a0e4b0044 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:32.856544 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-17b74353-496e-46a7-8ea2-584a0e4b0044 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:32.857022 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-17b74353-496e-46a7-8ea2-584a0e4b0044 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:32.990845 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-17b74353-496e-46a7-8ea2-584a0e4b0044 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:32.998984 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-17b74353-496e-46a7-8ea2-584a0e4b0044 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:33.000495 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-17b74353-496e-46a7-8ea2-584a0e4b0044 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:33.001625 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-17b74353-496e-46a7-8ea2-584a0e4b0044 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1406 microversion: 2.20 time: 0.160474 May 23 17:22:33.002176 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 302/591] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:22:32 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:22:33.274594 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8a6c18b2-c7f5-4bb5-ab1b-95454d27e84f tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:33.275612 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8a6c18b2-c7f5-4bb5-ab1b-95454d27e84f tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2391a78f-53ee-4e0f-b59f-5978e3ee93a0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:33.286945 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8a6c18b2-c7f5-4bb5-ab1b-95454d27e84f tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:33.287729 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8a6c18b2-c7f5-4bb5-ab1b-95454d27e84f tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:33.289328 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8a6c18b2-c7f5-4bb5-ab1b-95454d27e84f tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:33.290058 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8a6c18b2-c7f5-4bb5-ab1b-95454d27e84f tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:33.424729 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8a6c18b2-c7f5-4bb5-ab1b-95454d27e84f tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:33.435813 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8a6c18b2-c7f5-4bb5-ab1b-95454d27e84f tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0" status: 200 len: 1574 microversion: 2.1 time: 0.167713 May 23 17:22:33.436371 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 290/592] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:33 2022] GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0 => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:34.019795 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-7ce05f09-5f47-4340-9b94-316bf0ce3123 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:34.020405 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-7ce05f09-5f47-4340-9b94-316bf0ce3123 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:34.027970 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7ce05f09-5f47-4340-9b94-316bf0ce3123 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:34.028430 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7ce05f09-5f47-4340-9b94-316bf0ce3123 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:34.029243 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7ce05f09-5f47-4340-9b94-316bf0ce3123 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:34.029677 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7ce05f09-5f47-4340-9b94-316bf0ce3123 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:34.167289 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-7ce05f09-5f47-4340-9b94-316bf0ce3123 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:34.175643 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-7ce05f09-5f47-4340-9b94-316bf0ce3123 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:34.177196 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-7ce05f09-5f47-4340-9b94-316bf0ce3123 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:34.178332 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-7ce05f09-5f47-4340-9b94-316bf0ce3123 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1406 microversion: 2.20 time: 0.162863 May 23 17:22:34.178887 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 303/593] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:22:34 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:22:34.453741 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-62599cd8-ef8d-401e-9fd7-fde891bec601 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:34.454361 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-62599cd8-ef8d-401e-9fd7-fde891bec601 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2391a78f-53ee-4e0f-b59f-5978e3ee93a0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:34.461419 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-62599cd8-ef8d-401e-9fd7-fde891bec601 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:34.461870 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-62599cd8-ef8d-401e-9fd7-fde891bec601 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:34.462634 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-62599cd8-ef8d-401e-9fd7-fde891bec601 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:34.463073 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-62599cd8-ef8d-401e-9fd7-fde891bec601 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:34.599742 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-62599cd8-ef8d-401e-9fd7-fde891bec601 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:34.607702 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-62599cd8-ef8d-401e-9fd7-fde891bec601 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0" status: 200 len: 1574 microversion: 2.1 time: 0.157951 May 23 17:22:34.608308 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 291/594] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:34 2022] GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:35.201409 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-bfd593d4-dafa-4221-b68c-7f34f23d47b4 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:35.202795 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-bfd593d4-dafa-4221-b68c-7f34f23d47b4 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:35.211308 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bfd593d4-dafa-4221-b68c-7f34f23d47b4 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:35.211797 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bfd593d4-dafa-4221-b68c-7f34f23d47b4 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:35.212898 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bfd593d4-dafa-4221-b68c-7f34f23d47b4 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:35.213592 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bfd593d4-dafa-4221-b68c-7f34f23d47b4 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:35.345681 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-bfd593d4-dafa-4221-b68c-7f34f23d47b4 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:35.353675 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-bfd593d4-dafa-4221-b68c-7f34f23d47b4 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:35.355183 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-bfd593d4-dafa-4221-b68c-7f34f23d47b4 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:35.356404 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-bfd593d4-dafa-4221-b68c-7f34f23d47b4 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1597 microversion: 2.20 time: 0.159171 May 23 17:22:35.356980 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 304/595] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:22:35 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1597 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:22:35.376195 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-357eb7b9-943b-4869-8c87-038a39ca55b8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:35.378980 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-357eb7b9-943b-4869-8c87-038a39ca55b8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:35.386014 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-357eb7b9-943b-4869-8c87-038a39ca55b8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:35.386760 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-357eb7b9-943b-4869-8c87-038a39ca55b8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:35.388557 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-357eb7b9-943b-4869-8c87-038a39ca55b8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:35.388557 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-357eb7b9-943b-4869-8c87-038a39ca55b8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:35.469799 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-357eb7b9-943b-4869-8c87-038a39ca55b8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.099759 May 23 17:22:35.470793 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 292/596] 10.222.0.46 () {60 vars in 1315 bytes} [Mon May 23 17:22:35 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 17:22:35.625410 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-8aa87ef9-1fd6-4642-a231-7d522298a536 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:35.626476 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-8aa87ef9-1fd6-4642-a231-7d522298a536 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2391a78f-53ee-4e0f-b59f-5978e3ee93a0] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:35.633129 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8aa87ef9-1fd6-4642-a231-7d522298a536 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:35.633676 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8aa87ef9-1fd6-4642-a231-7d522298a536 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:35.634517 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8aa87ef9-1fd6-4642-a231-7d522298a536 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:35.635030 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8aa87ef9-1fd6-4642-a231-7d522298a536 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:35.717967 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-8aa87ef9-1fd6-4642-a231-7d522298a536 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:35.726589 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-8aa87ef9-1fd6-4642-a231-7d522298a536 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0" status: 200 len: 1508 microversion: 2.1 time: 0.105212 May 23 17:22:35.736768 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 305/597] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:35 2022] GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0 => generated 1508 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:35.902200 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-6c0956c3-8cdc-4e1c-9503-d68147a901af req-85780f76-6d53-4c5f-984d-2a39f67e77f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2391a78f-53ee-4e0f-b59f-5978e3ee93a0", "name": "network-vif-deleted", "tag": "d1a4e9d0-3b46-48b5-8e5d-788e05f3721f"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:22:35.910511 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:22:35.913519 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-6c0956c3-8cdc-4e1c-9503-d68147a901af req-85780f76-6d53-4c5f-984d-2a39f67e77f8 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:35.914156 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-6c0956c3-8cdc-4e1c-9503-d68147a901af req-85780f76-6d53-4c5f-984d-2a39f67e77f8 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:35.926845 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-6c0956c3-8cdc-4e1c-9503-d68147a901af req-85780f76-6d53-4c5f-984d-2a39f67e77f8 service nova] Creating event network-vif-deleted:d1a4e9d0-3b46-48b5-8e5d-788e05f3721f for instance 2391a78f-53ee-4e0f-b59f-5978e3ee93a0 on hv-cinder-84299 May 23 17:22:35.932571 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-6c0956c3-8cdc-4e1c-9503-d68147a901af req-85780f76-6d53-4c5f-984d-2a39f67e77f8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034225 May 23 17:22:35.933539 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 293/598] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:22:36.689735 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-c5b86071-2bfe-4294-9d65-4ccfa35f128a req-e056cf41-0450-4d42-a313-51b85ba1c385 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "549b0d88-0258-406c-90f1-fe4af4916e98", "tag": "d71c640f-947d-49b7-9fa5-19acd7e88bcb"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:22:36.698400 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-c5b86071-2bfe-4294-9d65-4ccfa35f128a req-e056cf41-0450-4d42-a313-51b85ba1c385 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:36.698833 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-c5b86071-2bfe-4294-9d65-4ccfa35f128a req-e056cf41-0450-4d42-a313-51b85ba1c385 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:36.710818 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-c5b86071-2bfe-4294-9d65-4ccfa35f128a req-e056cf41-0450-4d42-a313-51b85ba1c385 service nova] Creating event network-changed:d71c640f-947d-49b7-9fa5-19acd7e88bcb for instance 549b0d88-0258-406c-90f1-fe4af4916e98 on hv-cinder-84299 May 23 17:22:36.716458 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-c5b86071-2bfe-4294-9d65-4ccfa35f128a req-e056cf41-0450-4d42-a313-51b85ba1c385 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030432 May 23 17:22:36.719627 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 306/599] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 17:22:36.744557 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6f5068fe-ae5b-428e-bf8e-fb00f7162c93 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:36.745297 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6f5068fe-ae5b-428e-bf8e-fb00f7162c93 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2391a78f-53ee-4e0f-b59f-5978e3ee93a0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:36.753323 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6f5068fe-ae5b-428e-bf8e-fb00f7162c93 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:36.753749 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6f5068fe-ae5b-428e-bf8e-fb00f7162c93 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:36.754526 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6f5068fe-ae5b-428e-bf8e-fb00f7162c93 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:36.754961 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6f5068fe-ae5b-428e-bf8e-fb00f7162c93 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:36.760990 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:22:36.831209 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6f5068fe-ae5b-428e-bf8e-fb00f7162c93 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:36.839217 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6f5068fe-ae5b-428e-bf8e-fb00f7162c93 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0" status: 200 len: 1508 microversion: 2.1 time: 0.099418 May 23 17:22:36.848975 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 294/600] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:36 2022] GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0 => generated 1508 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:37.857952 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-9cd8f29e-3220-463c-ad3f-ef63252ec87b tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:37.858686 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-9cd8f29e-3220-463c-ad3f-ef63252ec87b tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2391a78f-53ee-4e0f-b59f-5978e3ee93a0] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:37.866452 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9cd8f29e-3220-463c-ad3f-ef63252ec87b tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:37.866905 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9cd8f29e-3220-463c-ad3f-ef63252ec87b tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:37.867775 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9cd8f29e-3220-463c-ad3f-ef63252ec87b tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:37.868214 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9cd8f29e-3220-463c-ad3f-ef63252ec87b tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:37.930480 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9cd8f29e-3220-463c-ad3f-ef63252ec87b tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:37.938153 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-9cd8f29e-3220-463c-ad3f-ef63252ec87b tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0" status: 200 len: 1225 microversion: 2.1 time: 0.085144 May 23 17:22:37.938725 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 307/601] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:37 2022] GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:38.961134 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-49a4ee78-bc20-45c5-9e53-40568e119866 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:38.961798 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-49a4ee78-bc20-45c5-9e53-40568e119866 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2391a78f-53ee-4e0f-b59f-5978e3ee93a0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:38.970284 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-49a4ee78-bc20-45c5-9e53-40568e119866 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:38.970735 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-49a4ee78-bc20-45c5-9e53-40568e119866 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:38.971496 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-49a4ee78-bc20-45c5-9e53-40568e119866 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:38.971927 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-49a4ee78-bc20-45c5-9e53-40568e119866 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:39.006065 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-49a4ee78-bc20-45c5-9e53-40568e119866 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:39.006507 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-49a4ee78-bc20-45c5-9e53-40568e119866 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:39.006968 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.objects.instance [None req-49a4ee78-bc20-45c5-9e53-40568e119866 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lazy-loading 'fault' on Instance uuid 2391a78f-53ee-4e0f-b59f-5978e3ee93a0 {{(pid=117909) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 17:22:39.050980 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-49a4ee78-bc20-45c5-9e53-40568e119866 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:39.059191 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-49a4ee78-bc20-45c5-9e53-40568e119866 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0" status: 200 len: 1230 microversion: 2.1 time: 0.106132 May 23 17:22:39.060154 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 295/602] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:38 2022] GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0 => generated 1230 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:40.079025 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-debbf4c4-d2ee-4b83-abca-483ab21f914a tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:40.079706 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-debbf4c4-d2ee-4b83-abca-483ab21f914a tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2391a78f-53ee-4e0f-b59f-5978e3ee93a0] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:40.087589 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-debbf4c4-d2ee-4b83-abca-483ab21f914a tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:40.088135 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-debbf4c4-d2ee-4b83-abca-483ab21f914a tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:40.089051 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-debbf4c4-d2ee-4b83-abca-483ab21f914a tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:40.089564 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-debbf4c4-d2ee-4b83-abca-483ab21f914a tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:40.105799 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-debbf4c4-d2ee-4b83-abca-483ab21f914a tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] HTTP exception thrown: Instance 2391a78f-53ee-4e0f-b59f-5978e3ee93a0 could not be found. May 23 17:22:40.107643 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-debbf4c4-d2ee-4b83-abca-483ab21f914a tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Request method failure captured: May 23 17:22:40.107643 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: request: GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0 HTTP/1.1 May 23 17:22:40.107643 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept: application/json May 23 17:22:40.107643 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity May 23 17:22:40.107643 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Connection: close May 23 17:22:40.107643 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Length: 0 May 23 17:22:40.107643 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Type: application/json May 23 17:22:40.107643 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Host: 10.222.0.46 May 23 17:22:40.107643 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None May 23 17:22:40.107643 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.9 May 23 17:22:40.107643 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABii8IJ0xnlh991vdAkzlqZuR3jYW9VmNK_4Z5wbIDqB_PpITXEm6-e4APorfgZdZ3nHqu7BEGWFCgpbJBxpDfU9yTxsRmgCzw5QH9LZFFbCdWUTN5GY4dmIDiGdkWhgDqPtD8wYfsus7_VobeVwBHZmlnmU5iw2CFgkkMwvISPdBTRGO4 May 23 17:22:40.107643 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Id: None May 23 17:22:40.107643 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Name: None May 23 17:22:40.107643 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed May 23 17:22:40.107643 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True May 23 17:22:40.107643 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default May 23 17:22:40.107643 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default May 23 17:22:40.107643 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Id: df984bae4f4e4d01ac06870bee8a73bf May 23 17:22:40.107643 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-TestVolumeBootPattern-1482174366 May 23 17:22:40.107643 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Role: reader,member May 23 17:22:40.107643 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Roles: reader,member May 23 17:22:40.109284 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/df984bae4f4e4d01ac06870bee8a73bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/df984bae4f4e4d01ac06870bee8a73bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/df984bae4f4e4d01ac06870bee8a73bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_df984bae4f4e4d01ac06870bee8a73bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:22:40.109284 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-TestVolumeBootPattern-1482174366 May 23 17:22:40.109284 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Id: df984bae4f4e4d01ac06870bee8a73bf May 23 17:22:40.109284 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-TestVolumeBootPattern-1482174366 May 23 17:22:40.109284 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User: tempest-TestVolumeBootPattern-1482174366-project May 23 17:22:40.109284 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default May 23 17:22:40.109284 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default May 23 17:22:40.109284 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Id: dc9c9dd337834dea821cc4ea6ecc10a6 May 23 17:22:40.109284 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-TestVolumeBootPattern-1482174366-project May 23 17:22:40.109284 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: method: > May 23 17:22:40.109284 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: exception: Instance 2391a78f-53ee-4e0f-b59f-5978e3ee93a0 could not be found. May 23 17:22:40.109284 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: action_args: {'id': '2391a78f-53ee-4e0f-b59f-5978e3ee93a0'} May 23 17:22:40.110299 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:22:40.110299 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:22:40.110299 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:22:40.110299 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:22:40.110299 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:22:40.110299 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:22:40.110299 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:22:40.110299 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:22:40.110299 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:22:40.110299 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:22:40.110299 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2391a78f-53ee-4e0f-b59f-5978e3ee93a0 could not be found. May 23 17:22:40.110299 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:22:40.110299 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:22:40.110299 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:22:40.110299 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:22:40.110299 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:22:40.110299 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:22:40.110299 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:22:40.110299 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:22:40.110299 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:22:40.111685 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:22:40.111685 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 17:22:40.111685 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 17:22:40.111685 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:22:40.111685 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:22:40.111685 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:22:40.111685 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:22:40.111685 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2391a78f-53ee-4e0f-b59f-5978e3ee93a0 could not be found. May 23 17:22:40.111685 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:22:40.111685 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:22:40.111685 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:22:40.111685 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:22:40.111685 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:22:40.111685 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:22:40.111685 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:22:40.111685 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:22:40.111685 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2391a78f-53ee-4e0f-b59f-5978e3ee93a0 could not be found. May 23 17:22:40.111685 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:22:40.113072 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-debbf4c4-d2ee-4b83-abca-483ab21f914a tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Returning 404 to user: Instance 2391a78f-53ee-4e0f-b59f-5978e3ee93a0 could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:22:40.113072 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-debbf4c4-d2ee-4b83-abca-483ab21f914a tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0" status: 404 len: 111 microversion: 2.1 time: 0.035199 May 23 17:22:40.113072 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 308/603] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:40 2022] GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:22:40.212271 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b2368403-cb47-4765-a2a0-a547a030e720 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1817145489", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-423638123", "security_groups": [{"name": "tempest-secgroup-smoke-59473231"}], "block_device_mapping_v2": [{"uuid": "b1fab6af-c334-42e7-972b-753c6adeff09", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "53cf278b-29c3-4094-b45f-c66c3ecb5db2"}]}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:22:40.348827 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.network.neutron [None req-b2368403-cb47-4765-a2a0-a547a030e720 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] validate_networks() for [('53cf278b-29c3-4094-b45f-c66c3ecb5db2', None, None, None, None, None)] {{(pid=117909) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 17:22:40.720223 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-b2368403-cb47-4765-a2a0-a547a030e720 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Flavor limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 17:22:40.720761 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-b2368403-cb47-4765-a2a0-a547a030e720 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Image limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 17:22:40.721805 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-b2368403-cb47-4765-a2a0-a547a030e720 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Flavor pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 17:22:40.722216 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-b2368403-cb47-4765-a2a0-a547a030e720 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Image pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 17:22:40.722623 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-b2368403-cb47-4765-a2a0-a547a030e720 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 17:22:40.732088 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b2368403-cb47-4765-a2a0-a547a030e720 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:40.732517 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b2368403-cb47-4765-a2a0-a547a030e720 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:40.733359 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b2368403-cb47-4765-a2a0-a547a030e720 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:40.733791 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b2368403-cb47-4765-a2a0-a547a030e720 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:40.750158 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-b2368403-cb47-4765-a2a0-a547a030e720 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Getting quotas for project df984bae4f4e4d01ac06870bee8a73bf. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 17:22:40.754252 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-b2368403-cb47-4765-a2a0-a547a030e720 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Getting quotas for user dc9c9dd337834dea821cc4ea6ecc10a6 and project df984bae4f4e4d01ac06870bee8a73bf. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 17:22:40.819819 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b2368403-cb47-4765-a2a0-a547a030e720 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Going to run 1 instances... {{(pid=117909) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 17:22:40.822281 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b2368403-cb47-4765-a2a0-a547a030e720 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b1fab6af-c334-42e7-972b-753c6adeff09',volume_size=None,volume_type=None)] {{(pid=117909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 17:22:40.957771 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b2368403-cb47-4765-a2a0-a547a030e720 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.749341 May 23 17:22:40.958447 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 296/604] 10.222.0.46 () {60 vars in 1146 bytes} [Mon May 23 17:22:40 2022] POST /compute/v2.1/servers => generated 404 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 17:22:40.968490 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2913e36b-ed8c-404a-873d-02a78ccb23cc tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:40.969122 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2913e36b-ed8c-404a-873d-02a78ccb23cc tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:41.025858 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2913e36b-ed8c-404a-873d-02a78ccb23cc tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:41.033104 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2913e36b-ed8c-404a-873d-02a78ccb23cc tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b" status: 200 len: 1094 microversion: 2.1 time: 0.068418 May 23 17:22:41.033694 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 309/605] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:40 2022] GET /compute/v2.1/servers/2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:42.050360 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a051ff98-e795-4b61-8e41-18489e5afb79 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:42.051467 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a051ff98-e795-4b61-8e41-18489e5afb79 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:42.059204 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a051ff98-e795-4b61-8e41-18489e5afb79 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:42.059722 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a051ff98-e795-4b61-8e41-18489e5afb79 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:42.060759 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a051ff98-e795-4b61-8e41-18489e5afb79 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:42.061408 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a051ff98-e795-4b61-8e41-18489e5afb79 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:42.304783 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a051ff98-e795-4b61-8e41-18489e5afb79 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:42.314234 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a051ff98-e795-4b61-8e41-18489e5afb79 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b" status: 200 len: 1210 microversion: 2.1 time: 0.268443 May 23 17:22:42.314977 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 297/606] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:42 2022] GET /compute/v2.1/servers/2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b => generated 1210 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:43.332348 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-4ae33520-1e64-4c22-9b0d-86893482b832 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:43.333096 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-4ae33520-1e64-4c22-9b0d-86893482b832 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:43.342877 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4ae33520-1e64-4c22-9b0d-86893482b832 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:43.343352 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4ae33520-1e64-4c22-9b0d-86893482b832 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:43.344162 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4ae33520-1e64-4c22-9b0d-86893482b832 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:43.344712 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4ae33520-1e64-4c22-9b0d-86893482b832 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:43.393353 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-e913555b-3616-4d27-bb92-555431a6cf0f req-590358bd-33b8-4081-9e02-357fd969204a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b", "tag": "74f45bbf-1787-4f63-af3f-00e8870f4cb8"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:22:43.425577 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-e913555b-3616-4d27-bb92-555431a6cf0f req-590358bd-33b8-4081-9e02-357fd969204a service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:43.426392 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-e913555b-3616-4d27-bb92-555431a6cf0f req-590358bd-33b8-4081-9e02-357fd969204a service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:43.441178 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-e913555b-3616-4d27-bb92-555431a6cf0f req-590358bd-33b8-4081-9e02-357fd969204a service nova] Creating event network-changed:74f45bbf-1787-4f63-af3f-00e8870f4cb8 for instance 2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b on hv-cinder-84299 May 23 17:22:43.446675 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-e913555b-3616-4d27-bb92-555431a6cf0f req-590358bd-33b8-4081-9e02-357fd969204a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064548 May 23 17:22:43.447901 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 298/607] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:22:43.553863 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-4ae33520-1e64-4c22-9b0d-86893482b832 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:43.563097 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-4ae33520-1e64-4c22-9b0d-86893482b832 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b" status: 200 len: 1264 microversion: 2.1 time: 0.234833 May 23 17:22:43.563606 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 310/608] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:43 2022] GET /compute/v2.1/servers/2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b => generated 1264 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:44.580949 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c99b3889-4c05-49e8-8b6f-d5c6302c68f2 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:44.581602 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c99b3889-4c05-49e8-8b6f-d5c6302c68f2 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:44.590049 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c99b3889-4c05-49e8-8b6f-d5c6302c68f2 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:44.592841 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c99b3889-4c05-49e8-8b6f-d5c6302c68f2 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:44.593646 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c99b3889-4c05-49e8-8b6f-d5c6302c68f2 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:44.594078 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c99b3889-4c05-49e8-8b6f-d5c6302c68f2 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:44.739071 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c99b3889-4c05-49e8-8b6f-d5c6302c68f2 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:44.747130 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c99b3889-4c05-49e8-8b6f-d5c6302c68f2 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b" status: 200 len: 1264 microversion: 2.1 time: 0.170372 May 23 17:22:44.748176 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 299/609] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:44 2022] GET /compute/v2.1/servers/2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:45.773960 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d04a5890-94b2-4b54-a9bb-cffd89beba46 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:45.774909 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d04a5890-94b2-4b54-a9bb-cffd89beba46 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:45.785729 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d04a5890-94b2-4b54-a9bb-cffd89beba46 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:45.786387 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d04a5890-94b2-4b54-a9bb-cffd89beba46 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:45.787593 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d04a5890-94b2-4b54-a9bb-cffd89beba46 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:45.788270 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d04a5890-94b2-4b54-a9bb-cffd89beba46 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:45.925623 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d04a5890-94b2-4b54-a9bb-cffd89beba46 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:45.930552 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:22:45.935708 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d04a5890-94b2-4b54-a9bb-cffd89beba46 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b" status: 200 len: 1264 microversion: 2.1 time: 0.167716 May 23 17:22:45.936240 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 311/610] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:45 2022] GET /compute/v2.1/servers/2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:46.953022 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d5af2200-6a6b-4433-8fe0-a8e36e273e5f tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:46.953620 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d5af2200-6a6b-4433-8fe0-a8e36e273e5f tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:46.960444 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d5af2200-6a6b-4433-8fe0-a8e36e273e5f tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:46.960942 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d5af2200-6a6b-4433-8fe0-a8e36e273e5f tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:46.961758 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d5af2200-6a6b-4433-8fe0-a8e36e273e5f tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:46.962192 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d5af2200-6a6b-4433-8fe0-a8e36e273e5f tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:47.102847 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d5af2200-6a6b-4433-8fe0-a8e36e273e5f tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:47.114425 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d5af2200-6a6b-4433-8fe0-a8e36e273e5f tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b" status: 200 len: 1264 microversion: 2.1 time: 0.165030 May 23 17:22:47.115185 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 300/611] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:46 2022] GET /compute/v2.1/servers/2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:48.134447 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-02ce2004-ed8f-4d1a-9af0-62e061ee43fc tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:48.135076 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-02ce2004-ed8f-4d1a-9af0-62e061ee43fc tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:48.143231 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-02ce2004-ed8f-4d1a-9af0-62e061ee43fc tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:48.143685 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-02ce2004-ed8f-4d1a-9af0-62e061ee43fc tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:48.144500 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-02ce2004-ed8f-4d1a-9af0-62e061ee43fc tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:48.144981 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-02ce2004-ed8f-4d1a-9af0-62e061ee43fc tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:48.279973 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-02ce2004-ed8f-4d1a-9af0-62e061ee43fc tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:48.287656 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-02ce2004-ed8f-4d1a-9af0-62e061ee43fc tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b" status: 200 len: 1264 microversion: 2.1 time: 0.157532 May 23 17:22:48.288256 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 312/612] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:48 2022] GET /compute/v2.1/servers/2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:49.305394 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b29a8316-f17f-4915-baff-194ddf17ed5b tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:49.306135 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b29a8316-f17f-4915-baff-194ddf17ed5b tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:49.312361 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b29a8316-f17f-4915-baff-194ddf17ed5b tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:49.312849 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b29a8316-f17f-4915-baff-194ddf17ed5b tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:49.313646 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b29a8316-f17f-4915-baff-194ddf17ed5b tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:49.314082 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b29a8316-f17f-4915-baff-194ddf17ed5b tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:49.508644 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b29a8316-f17f-4915-baff-194ddf17ed5b tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:49.516930 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b29a8316-f17f-4915-baff-194ddf17ed5b tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b" status: 200 len: 1264 microversion: 2.1 time: 0.215697 May 23 17:22:49.517534 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 301/613] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:49 2022] GET /compute/v2.1/servers/2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b => generated 1264 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:50.533749 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a7af233e-8f09-4056-9926-468c84c6f43c tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:50.534389 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-a7af233e-8f09-4056-9926-468c84c6f43c tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:50.541705 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a7af233e-8f09-4056-9926-468c84c6f43c tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:50.542179 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a7af233e-8f09-4056-9926-468c84c6f43c tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:50.542984 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a7af233e-8f09-4056-9926-468c84c6f43c tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:50.543445 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a7af233e-8f09-4056-9926-468c84c6f43c tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:50.683853 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a7af233e-8f09-4056-9926-468c84c6f43c tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:50.693134 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-a7af233e-8f09-4056-9926-468c84c6f43c tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b" status: 200 len: 1264 microversion: 2.1 time: 0.163204 May 23 17:22:50.693785 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 313/614] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:50 2022] GET /compute/v2.1/servers/2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:51.710288 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7f74b6e7-51ce-4cf0-a2e4-530aefdfc0b7 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:51.710944 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7f74b6e7-51ce-4cf0-a2e4-530aefdfc0b7 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:51.713538 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=2 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:22:51.714231 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=6 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:22:51.720299 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7f74b6e7-51ce-4cf0-a2e4-530aefdfc0b7 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:51.720776 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7f74b6e7-51ce-4cf0-a2e4-530aefdfc0b7 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:51.721544 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7f74b6e7-51ce-4cf0-a2e4-530aefdfc0b7 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:51.721981 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7f74b6e7-51ce-4cf0-a2e4-530aefdfc0b7 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:51.857953 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7f74b6e7-51ce-4cf0-a2e4-530aefdfc0b7 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:51.865648 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7f74b6e7-51ce-4cf0-a2e4-530aefdfc0b7 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b" status: 200 len: 1264 microversion: 2.1 time: 0.159365 May 23 17:22:51.866214 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 302/615] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:51 2022] GET /compute/v2.1/servers/2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:52.883048 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-0b649876-214b-4e64-bc4b-0617c60f35fd tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:52.883582 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-0b649876-214b-4e64-bc4b-0617c60f35fd tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:52.885467 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=2 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:22:52.892049 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0b649876-214b-4e64-bc4b-0617c60f35fd tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:52.892491 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0b649876-214b-4e64-bc4b-0617c60f35fd tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:52.893303 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0b649876-214b-4e64-bc4b-0617c60f35fd tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:52.893729 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0b649876-214b-4e64-bc4b-0617c60f35fd tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:53.027578 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-0b649876-214b-4e64-bc4b-0617c60f35fd tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:53.035188 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-0b649876-214b-4e64-bc4b-0617c60f35fd tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b" status: 200 len: 1264 microversion: 2.1 time: 0.156299 May 23 17:22:53.035799 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 314/616] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:52 2022] GET /compute/v2.1/servers/2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:54.055553 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-cb3c8cc6-2699-4970-9555-538bec0e7169 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:54.056466 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-cb3c8cc6-2699-4970-9555-538bec0e7169 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:54.067478 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cb3c8cc6-2699-4970-9555-538bec0e7169 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:54.068231 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cb3c8cc6-2699-4970-9555-538bec0e7169 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:54.069571 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cb3c8cc6-2699-4970-9555-538bec0e7169 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:54.070292 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cb3c8cc6-2699-4970-9555-538bec0e7169 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:54.209292 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-cb3c8cc6-2699-4970-9555-538bec0e7169 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:54.217097 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-cb3c8cc6-2699-4970-9555-538bec0e7169 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b" status: 200 len: 1264 microversion: 2.1 time: 0.168099 May 23 17:22:54.217682 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 303/617] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:54 2022] GET /compute/v2.1/servers/2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:54.509921 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-d0553680-21c4-4f3f-8ab9-4cccd181fe9f req-c842f80c-2b77-44e6-bd96-c87c5fa2b6cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b", "name": "network-vif-plugged", "status": "completed", "tag": "74f45bbf-1787-4f63-af3f-00e8870f4cb8"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:22:54.519435 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-d0553680-21c4-4f3f-8ab9-4cccd181fe9f req-c842f80c-2b77-44e6-bd96-c87c5fa2b6cb service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:54.519936 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-d0553680-21c4-4f3f-8ab9-4cccd181fe9f req-c842f80c-2b77-44e6-bd96-c87c5fa2b6cb service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:54.531746 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-d0553680-21c4-4f3f-8ab9-4cccd181fe9f req-c842f80c-2b77-44e6-bd96-c87c5fa2b6cb service nova] Creating event network-vif-plugged:74f45bbf-1787-4f63-af3f-00e8870f4cb8 for instance 2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b on hv-cinder-84299 May 23 17:22:54.536690 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-d0553680-21c4-4f3f-8ab9-4cccd181fe9f req-c842f80c-2b77-44e6-bd96-c87c5fa2b6cb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030522 May 23 17:22:54.537483 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 315/618] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:22:55.234760 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3e1e612e-9e6d-474e-8bf2-b826c81dc72a tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:55.235407 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3e1e612e-9e6d-474e-8bf2-b826c81dc72a tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:55.243353 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3e1e612e-9e6d-474e-8bf2-b826c81dc72a tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:55.243862 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3e1e612e-9e6d-474e-8bf2-b826c81dc72a tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:55.244750 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3e1e612e-9e6d-474e-8bf2-b826c81dc72a tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:55.245241 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3e1e612e-9e6d-474e-8bf2-b826c81dc72a tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:55.378184 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3e1e612e-9e6d-474e-8bf2-b826c81dc72a tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:55.386214 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3e1e612e-9e6d-474e-8bf2-b826c81dc72a tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b" status: 200 len: 1264 microversion: 2.1 time: 0.155890 May 23 17:22:55.386761 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 304/619] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:55 2022] GET /compute/v2.1/servers/2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:56.409789 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-0f4a1170-edcd-47f5-b496-c9926396559b tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:56.410921 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-0f4a1170-edcd-47f5-b496-c9926396559b tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:56.421907 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0f4a1170-edcd-47f5-b496-c9926396559b tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:56.422361 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0f4a1170-edcd-47f5-b496-c9926396559b tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:56.423154 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0f4a1170-edcd-47f5-b496-c9926396559b tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:56.423712 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0f4a1170-edcd-47f5-b496-c9926396559b tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:56.555793 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-0f4a1170-edcd-47f5-b496-c9926396559b tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:56.563555 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-0f4a1170-edcd-47f5-b496-c9926396559b tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b" status: 200 len: 1451 microversion: 2.1 time: 0.161969 May 23 17:22:56.564126 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 316/620] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:56 2022] GET /compute/v2.1/servers/2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b => generated 1451 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:56.587797 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d7ea9772-6e37-4070-89e8-6d79ef7008d0 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:22:56.588423 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d7ea9772-6e37-4070-89e8-6d79ef7008d0 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:56.597011 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d7ea9772-6e37-4070-89e8-6d79ef7008d0 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:56.597466 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d7ea9772-6e37-4070-89e8-6d79ef7008d0 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:56.598230 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d7ea9772-6e37-4070-89e8-6d79ef7008d0 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:56.598666 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d7ea9772-6e37-4070-89e8-6d79ef7008d0 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:56.739758 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d7ea9772-6e37-4070-89e8-6d79ef7008d0 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:22:56.747563 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d7ea9772-6e37-4070-89e8-6d79ef7008d0 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b" status: 200 len: 1451 microversion: 2.1 time: 0.165858 May 23 17:22:56.748146 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 305/621] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:22:56 2022] GET /compute/v2.1/servers/2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b => generated 1451 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:22:58.443895 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-195464e0-350a-4688-a774-d6da9e844f6b req-eaaa9774-140e-4592-b16b-6caa8c5b9dfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b", "tag": "74f45bbf-1787-4f63-af3f-00e8870f4cb8"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:22:58.452636 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-195464e0-350a-4688-a774-d6da9e844f6b req-eaaa9774-140e-4592-b16b-6caa8c5b9dfd service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:58.453131 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-195464e0-350a-4688-a774-d6da9e844f6b req-eaaa9774-140e-4592-b16b-6caa8c5b9dfd service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:58.466102 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-195464e0-350a-4688-a774-d6da9e844f6b req-eaaa9774-140e-4592-b16b-6caa8c5b9dfd service nova] Creating event network-changed:74f45bbf-1787-4f63-af3f-00e8870f4cb8 for instance 2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b on hv-cinder-84299 May 23 17:22:58.471346 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-195464e0-350a-4688-a774-d6da9e844f6b req-eaaa9774-140e-4592-b16b-6caa8c5b9dfd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031161 May 23 17:22:58.472508 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 317/622] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:22:59.627593 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-86f68f42-8720-458f-97f5-4b5eaf39aafd tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-197333049"}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:22:59.628103 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-86f68f42-8720-458f-97f5-4b5eaf39aafd tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:22:59.634786 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-86f68f42-8720-458f-97f5-4b5eaf39aafd tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:59.635243 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-86f68f42-8720-458f-97f5-4b5eaf39aafd tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:59.636024 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-86f68f42-8720-458f-97f5-4b5eaf39aafd tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:22:59.636461 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-86f68f42-8720-458f-97f5-4b5eaf39aafd tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:22:59.767846 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.network.security_group_api [None req-86f68f42-8720-458f-97f5-4b5eaf39aafd tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Removing security group 76fabacc-43ab-483b-a0c9-6074c11f5723 from port b64de995-4ddd-4471-a42a-480203d490ce May 23 17:23:00.163053 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-86f68f42-8720-458f-97f5-4b5eaf39aafd tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "POST /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2/action" status: 202 len: 0 microversion: 2.1 time: 0.539691 May 23 17:23:00.163673 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 306/623] 10.222.0.46 () {60 vars in 1277 bytes} [Mon May 23 17:22:59 2022] POST /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2/action => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 17:23:00.491725 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-c7c812a2-da20-4e0f-828b-98553f856627 req-5434f79c-a590-49b0-ba41-166ba60a64b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c6c849e-492f-4bd4-91d8-f1622420a3d2", "tag": "b64de995-4ddd-4471-a42a-480203d490ce"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:23:00.502029 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-c7c812a2-da20-4e0f-828b-98553f856627 req-5434f79c-a590-49b0-ba41-166ba60a64b8 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:00.502475 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-c7c812a2-da20-4e0f-828b-98553f856627 req-5434f79c-a590-49b0-ba41-166ba60a64b8 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:00.514716 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-c7c812a2-da20-4e0f-828b-98553f856627 req-5434f79c-a590-49b0-ba41-166ba60a64b8 service nova] Creating event network-changed:b64de995-4ddd-4471-a42a-480203d490ce for instance 7c6c849e-492f-4bd4-91d8-f1622420a3d2 on hv-cinder-84299 May 23 17:23:00.520302 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-c7c812a2-da20-4e0f-828b-98553f856627 req-5434f79c-a590-49b0-ba41-166ba60a64b8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033457 May 23 17:23:00.521400 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 318/624] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:23:01.436195 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4c794f20-7936-435d-9b1e-2a54c3bcf4c6 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:01.436747 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4c794f20-7936-435d-9b1e-2a54c3bcf4c6 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:01.443021 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c794f20-7936-435d-9b1e-2a54c3bcf4c6 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:01.443482 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c794f20-7936-435d-9b1e-2a54c3bcf4c6 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:01.444236 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c794f20-7936-435d-9b1e-2a54c3bcf4c6 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:01.444696 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c794f20-7936-435d-9b1e-2a54c3bcf4c6 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:01.526166 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.objects.instance [None req-4c794f20-7936-435d-9b1e-2a54c3bcf4c6 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lazy-loading 'services' on Instance uuid 7c6c849e-492f-4bd4-91d8-f1622420a3d2 {{(pid=117909) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 17:23:01.643278 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4c794f20-7936-435d-9b1e-2a54c3bcf4c6 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2/os-volume_attachments/daa76b23-d1c8-41f0-88f6-d3966a9062d1" status: 202 len: 0 microversion: 2.1 time: 0.211138 May 23 17:23:01.643878 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 307/625] 10.222.0.46 () {58 vars in 1415 bytes} [Mon May 23 17:23:01 2022] DELETE /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2/os-volume_attachments/daa76b23-d1c8-41f0-88f6-d3966a9062d1 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 17:23:01.660583 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-bddc5cc8-6ad7-4355-b0d8-737acf031d5a tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:01.663130 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-bddc5cc8-6ad7-4355-b0d8-737acf031d5a tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:01.673052 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bddc5cc8-6ad7-4355-b0d8-737acf031d5a tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:01.673507 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bddc5cc8-6ad7-4355-b0d8-737acf031d5a tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:01.674496 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bddc5cc8-6ad7-4355-b0d8-737acf031d5a tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:01.675092 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bddc5cc8-6ad7-4355-b0d8-737acf031d5a tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:01.710467 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-bddc5cc8-6ad7-4355-b0d8-737acf031d5a tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061493 May 23 17:23:01.711049 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 319/626] 10.222.0.46 () {58 vars in 1301 bytes} [Mon May 23 17:23:01 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:23:02.546568 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-78859f1f-b9b7-4c24-a25a-5f3aacd82d7f req-3f8c0439-74f6-46e6-ba7f-3cfc8c6dbeb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c6c849e-492f-4bd4-91d8-f1622420a3d2", "tag": "b64de995-4ddd-4471-a42a-480203d490ce"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:23:02.555703 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-78859f1f-b9b7-4c24-a25a-5f3aacd82d7f req-3f8c0439-74f6-46e6-ba7f-3cfc8c6dbeb0 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:02.556130 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-78859f1f-b9b7-4c24-a25a-5f3aacd82d7f req-3f8c0439-74f6-46e6-ba7f-3cfc8c6dbeb0 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:02.567783 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-78859f1f-b9b7-4c24-a25a-5f3aacd82d7f req-3f8c0439-74f6-46e6-ba7f-3cfc8c6dbeb0 service nova] Creating event network-changed:b64de995-4ddd-4471-a42a-480203d490ce for instance 7c6c849e-492f-4bd4-91d8-f1622420a3d2 on hv-cinder-84299 May 23 17:23:02.573039 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-78859f1f-b9b7-4c24-a25a-5f3aacd82d7f req-3f8c0439-74f6-46e6-ba7f-3cfc8c6dbeb0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030677 May 23 17:23:02.573831 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 308/627] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 17:23:02.722033 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-f517519f-39d6-46e6-9e62-3a544a5cbdea tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:02.723108 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-f517519f-39d6-46e6-9e62-3a544a5cbdea tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:02.727001 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:23:02.730905 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f517519f-39d6-46e6-9e62-3a544a5cbdea tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:02.731434 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f517519f-39d6-46e6-9e62-3a544a5cbdea tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:02.732463 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f517519f-39d6-46e6-9e62-3a544a5cbdea tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:02.733002 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f517519f-39d6-46e6-9e62-3a544a5cbdea tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:02.765584 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-f517519f-39d6-46e6-9e62-3a544a5cbdea tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047566 May 23 17:23:02.766196 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 320/628] 10.222.0.46 () {58 vars in 1301 bytes} [Mon May 23 17:23:02 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 17:23:02.777306 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4c90f941-717b-499c-803d-c100571cb73e tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:02.778285 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4c90f941-717b-499c-803d-c100571cb73e tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:02.788155 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c90f941-717b-499c-803d-c100571cb73e tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:02.788648 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c90f941-717b-499c-803d-c100571cb73e tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:02.792951 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c90f941-717b-499c-803d-c100571cb73e tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:02.793585 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c90f941-717b-499c-803d-c100571cb73e tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:02.827941 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-1d8e5e22-928b-4554-be34-6b464e156cd5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:02.828476 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-1d8e5e22-928b-4554-be34-6b464e156cd5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:02.834878 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1d8e5e22-928b-4554-be34-6b464e156cd5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:02.835331 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1d8e5e22-928b-4554-be34-6b464e156cd5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:02.836102 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1d8e5e22-928b-4554-be34-6b464e156cd5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:02.836573 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1d8e5e22-928b-4554-be34-6b464e156cd5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:02.885231 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-4c90f941-717b-499c-803d-c100571cb73e tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] HTTP exception thrown: Instance 7c6c849e-492f-4bd4-91d8-f1622420a3d2 is not attached to volume daa76b23-d1c8-41f0-88f6-d3966a9062d1 May 23 17:23:02.899629 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4c90f941-717b-499c-803d-c100571cb73e tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Request method failure captured: May 23 17:23:02.899629 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: request: DELETE /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2/os-volume_attachments/daa76b23-d1c8-41f0-88f6-d3966a9062d1 HTTP/1.1 May 23 17:23:02.899629 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept: application/json May 23 17:23:02.899629 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity May 23 17:23:02.899629 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Connection: close May 23 17:23:02.899629 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Length: 0 May 23 17:23:02.899629 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Type: application/json May 23 17:23:02.899629 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Host: 10.222.0.46 May 23 17:23:02.899629 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None May 23 17:23:02.899629 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.9 May 23 17:23:02.899629 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABii8IhFLc5SRrlV46mzjIbDGi8ISLvoKZzsVY6GBFzbQRsbQ-CU16CLddG_CLpJHHxROrhbw8MDM7ET3F1Qk7V_AVXba-3YVGdPfnKZNHD84SJ5rzQ2N9rexy37gu7GMbLTXQsHp2F-A8Dk7TiW7bYR12hWEeSmOAEsTDJRuz0wQ2-B8Y May 23 17:23:02.899629 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Id: None May 23 17:23:02.899629 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Name: None May 23 17:23:02.899629 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed May 23 17:23:02.899629 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True May 23 17:23:02.899629 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default May 23 17:23:02.899629 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default May 23 17:23:02.899629 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Id: 0cc6a8ff9f92432ba9433b78a948d042 May 23 17:23:02.899629 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-TestMinimumBasicScenario-1725668553 May 23 17:23:02.899629 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Role: reader,member May 23 17:23:02.899629 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Roles: reader,member May 23 17:23:02.901185 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0cc6a8ff9f92432ba9433b78a948d042"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0cc6a8ff9f92432ba9433b78a948d042"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0cc6a8ff9f92432ba9433b78a948d042"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0cc6a8ff9f92432ba9433b78a948d042"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:23:02.901185 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-TestMinimumBasicScenario-1725668553 May 23 17:23:02.901185 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 0cc6a8ff9f92432ba9433b78a948d042 May 23 17:23:02.901185 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1725668553 May 23 17:23:02.901185 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User: tempest-TestMinimumBasicScenario-1725668553-project May 23 17:23:02.901185 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default May 23 17:23:02.901185 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default May 23 17:23:02.901185 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Id: 63d18c022a19438d88562ef8e8c3fbce May 23 17:23:02.901185 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-TestMinimumBasicScenario-1725668553-project May 23 17:23:02.901185 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: method: > May 23 17:23:02.901185 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: exception: Instance 7c6c849e-492f-4bd4-91d8-f1622420a3d2 is not attached to volume daa76b23-d1c8-41f0-88f6-d3966a9062d1 May 23 17:23:02.902117 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: action_args: {'server_id': '7c6c849e-492f-4bd4-91d8-f1622420a3d2', 'id': 'daa76b23-d1c8-41f0-88f6-d3966a9062d1'} May 23 17:23:02.902117 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:23:02.902117 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:23:02.902117 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 23 17:23:02.902117 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 23 17:23:02.902117 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 17:23:02.902117 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 17:23:02.902117 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 23 17:23:02.902117 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 23 17:23:02.902117 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id daa76b23-d1c8-41f0-88f6-d3966a9062d1. May 23 17:23:02.902117 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:23:02.902117 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:23:02.902117 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:23:02.902117 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:23:02.902117 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:23:02.902117 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:23:02.902117 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:23:02.902117 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:23:02.902117 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:23:02.905179 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:23:02.905179 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 23 17:23:02.905179 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 23 17:23:02.905179 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c6c849e-492f-4bd4-91d8-f1622420a3d2 is not attached to volume daa76b23-d1c8-41f0-88f6-d3966a9062d1 May 23 17:23:02.905179 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:23:02.905179 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:23:02.905179 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:23:02.905179 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:23:02.905179 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:23:02.905179 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:23:02.905179 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:23:02.905179 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:23:02.905179 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c6c849e-492f-4bd4-91d8-f1622420a3d2 is not attached to volume daa76b23-d1c8-41f0-88f6-d3966a9062d1 May 23 17:23:02.905179 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:23:02.905179 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4c90f941-717b-499c-803d-c100571cb73e tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Returning 404 to user: Instance 7c6c849e-492f-4bd4-91d8-f1622420a3d2 is not attached to volume daa76b23-d1c8-41f0-88f6-d3966a9062d1 {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:23:02.906080 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4c90f941-717b-499c-803d-c100571cb73e tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2/os-volume_attachments/daa76b23-d1c8-41f0-88f6-d3966a9062d1" status: 404 len: 154 microversion: 2.1 time: 0.129955 May 23 17:23:02.906080 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 309/629] 10.222.0.46 () {58 vars in 1415 bytes} [Mon May 23 17:23:02 2022] DELETE /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2/os-volume_attachments/daa76b23-d1c8-41f0-88f6-d3966a9062d1 => generated 154 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:23:02.924588 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.objects.instance [None req-1d8e5e22-928b-4554-be34-6b464e156cd5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lazy-loading 'services' on Instance uuid c26b20b6-8a97-4aa1-af83-616cc09c9165 {{(pid=117910) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 17:23:03.002054 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-1d8e5e22-928b-4554-be34-6b464e156cd5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165/os-volume_attachments/82bf1310-3505-4c9d-b6c9-3e95f8371e04" status: 202 len: 0 microversion: 2.1 time: 0.177838 May 23 17:23:03.003013 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 321/630] 10.222.0.46 () {58 vars in 1415 bytes} [Mon May 23 17:23:02 2022] DELETE /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165/os-volume_attachments/82bf1310-3505-4c9d-b6c9-3e95f8371e04 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 17:23:03.011418 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-090863ff-8502-41bb-b36e-6b2ef17111c8 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:03.012886 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-090863ff-8502-41bb-b36e-6b2ef17111c8 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:03.020396 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-090863ff-8502-41bb-b36e-6b2ef17111c8 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:03.020923 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-090863ff-8502-41bb-b36e-6b2ef17111c8 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:03.021742 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-090863ff-8502-41bb-b36e-6b2ef17111c8 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:03.022397 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-090863ff-8502-41bb-b36e-6b2ef17111c8 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:03.057978 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-090863ff-8502-41bb-b36e-6b2ef17111c8 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050795 May 23 17:23:03.058545 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 310/631] 10.222.0.46 () {58 vars in 1301 bytes} [Mon May 23 17:23:03 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 17:23:04.071174 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-838fdd53-5ee1-4d58-be98-9c9406dd5056 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:04.072174 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-838fdd53-5ee1-4d58-be98-9c9406dd5056 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:04.072343 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-27254975-d322-446c-9652-19009e9edc57 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:04.072885 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-27254975-d322-446c-9652-19009e9edc57 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:04.079039 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-838fdd53-5ee1-4d58-be98-9c9406dd5056 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:04.079759 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-27254975-d322-446c-9652-19009e9edc57 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:04.079903 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-838fdd53-5ee1-4d58-be98-9c9406dd5056 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:04.080366 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-27254975-d322-446c-9652-19009e9edc57 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:04.081138 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-838fdd53-5ee1-4d58-be98-9c9406dd5056 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:04.081299 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-27254975-d322-446c-9652-19009e9edc57 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:04.081729 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-27254975-d322-446c-9652-19009e9edc57 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:04.081979 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-838fdd53-5ee1-4d58-be98-9c9406dd5056 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:04.107277 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-27254975-d322-446c-9652-19009e9edc57 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Going to try to terminate instance {{(pid=117909) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 17:23:04.116025 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-838fdd53-5ee1-4d58-be98-9c9406dd5056 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049661 May 23 17:23:04.116591 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 322/632] 10.222.0.46 () {58 vars in 1301 bytes} [Mon May 23 17:23:04 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 17:23:04.121840 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:23:04.192425 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-27254975-d322-446c-9652-19009e9edc57 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 204 len: 0 microversion: 2.1 time: 0.123883 May 23 17:23:04.193527 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 311/633] 10.222.0.46 () {58 vars in 1238 bytes} [Mon May 23 17:23:04 2022] DELETE /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 17:23:04.202003 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c418710f-b7d8-4a7f-a55f-5f5d75adbb5b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:04.202504 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c418710f-b7d8-4a7f-a55f-5f5d75adbb5b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:04.203383 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4f2de423-028b-43e9-a75f-88bc8d4b7d9e tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:04.204125 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4f2de423-028b-43e9-a75f-88bc8d4b7d9e tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:04.208644 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c418710f-b7d8-4a7f-a55f-5f5d75adbb5b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:04.209099 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c418710f-b7d8-4a7f-a55f-5f5d75adbb5b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:04.209869 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c418710f-b7d8-4a7f-a55f-5f5d75adbb5b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:04.210233 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4f2de423-028b-43e9-a75f-88bc8d4b7d9e tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:04.210338 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c418710f-b7d8-4a7f-a55f-5f5d75adbb5b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:04.210689 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4f2de423-028b-43e9-a75f-88bc8d4b7d9e tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:04.211458 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4f2de423-028b-43e9-a75f-88bc8d4b7d9e tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:04.211895 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4f2de423-028b-43e9-a75f-88bc8d4b7d9e tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:04.234805 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c418710f-b7d8-4a7f-a55f-5f5d75adbb5b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Going to try to terminate instance {{(pid=117910) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 17:23:04.316366 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c418710f-b7d8-4a7f-a55f-5f5d75adbb5b tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 204 len: 0 microversion: 2.1 time: 0.121815 May 23 17:23:04.317060 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 323/634] 10.222.0.46 () {58 vars in 1238 bytes} [Mon May 23 17:23:04 2022] DELETE /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 17:23:04.325326 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-15181cee-d3e3-435c-a199-f24e2b351036 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:04.326026 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-15181cee-d3e3-435c-a199-f24e2b351036 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:04.331826 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-15181cee-d3e3-435c-a199-f24e2b351036 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:04.332280 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-15181cee-d3e3-435c-a199-f24e2b351036 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:04.333112 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-15181cee-d3e3-435c-a199-f24e2b351036 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:04.333545 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-15181cee-d3e3-435c-a199-f24e2b351036 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:04.352871 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4f2de423-028b-43e9-a75f-88bc8d4b7d9e tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:04.360702 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4f2de423-028b-43e9-a75f-88bc8d4b7d9e tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1555 microversion: 2.1 time: 0.161499 May 23 17:23:04.361512 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 312/635] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:23:04 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:23:04.468758 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-15181cee-d3e3-435c-a199-f24e2b351036 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:04.480740 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-15181cee-d3e3-435c-a199-f24e2b351036 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1689 microversion: 2.1 time: 0.159145 May 23 17:23:04.481456 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 324/636] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:23:04 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:23:05.382020 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c2128aef-72b8-4af9-9f03-4d652d11a73e tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:05.383068 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c2128aef-72b8-4af9-9f03-4d652d11a73e tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:05.393365 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c2128aef-72b8-4af9-9f03-4d652d11a73e tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:05.393818 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c2128aef-72b8-4af9-9f03-4d652d11a73e tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:05.394599 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c2128aef-72b8-4af9-9f03-4d652d11a73e tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:05.395031 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c2128aef-72b8-4af9-9f03-4d652d11a73e tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:05.498090 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-167f9e59-6292-41b5-9256-d78eec773956 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:05.498672 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-167f9e59-6292-41b5-9256-d78eec773956 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:05.506590 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-167f9e59-6292-41b5-9256-d78eec773956 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:05.507210 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-167f9e59-6292-41b5-9256-d78eec773956 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:05.508402 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-167f9e59-6292-41b5-9256-d78eec773956 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:05.509061 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-167f9e59-6292-41b5-9256-d78eec773956 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:05.538379 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c2128aef-72b8-4af9-9f03-4d652d11a73e tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:05.546482 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c2128aef-72b8-4af9-9f03-4d652d11a73e tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1555 microversion: 2.1 time: 0.170933 May 23 17:23:05.547068 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 313/637] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:23:05 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1555 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:23:05.648123 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-167f9e59-6292-41b5-9256-d78eec773956 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:05.659154 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-167f9e59-6292-41b5-9256-d78eec773956 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1689 microversion: 2.1 time: 0.164916 May 23 17:23:05.659721 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 325/638] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:23:05 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:23:06.566911 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-79f0fe10-2ede-46ca-8791-e85b368f469c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:06.567677 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-79f0fe10-2ede-46ca-8791-e85b368f469c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:06.577020 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-79f0fe10-2ede-46ca-8791-e85b368f469c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:06.577618 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-79f0fe10-2ede-46ca-8791-e85b368f469c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:06.579168 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-79f0fe10-2ede-46ca-8791-e85b368f469c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:06.579719 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-79f0fe10-2ede-46ca-8791-e85b368f469c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:06.675640 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-00750413-69af-4082-99c5-4ed96303c48e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:06.676367 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-00750413-69af-4082-99c5-4ed96303c48e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:06.683663 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-00750413-69af-4082-99c5-4ed96303c48e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:06.684047 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-00750413-69af-4082-99c5-4ed96303c48e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:06.684862 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-00750413-69af-4082-99c5-4ed96303c48e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:06.685321 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-00750413-69af-4082-99c5-4ed96303c48e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:06.715987 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-79f0fe10-2ede-46ca-8791-e85b368f469c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:06.723663 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-79f0fe10-2ede-46ca-8791-e85b368f469c tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1555 microversion: 2.1 time: 0.162696 May 23 17:23:06.724242 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 314/639] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:23:06 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:23:06.815074 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-00750413-69af-4082-99c5-4ed96303c48e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:06.822993 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-00750413-69af-4082-99c5-4ed96303c48e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1689 microversion: 2.1 time: 0.151521 May 23 17:23:06.823550 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 326/640] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:23:06 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:23:07.741422 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-893b2955-8d7c-4619-8ade-70d413149112 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:07.742024 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-893b2955-8d7c-4619-8ade-70d413149112 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:07.744480 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:23:07.750221 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-893b2955-8d7c-4619-8ade-70d413149112 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:07.750655 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-893b2955-8d7c-4619-8ade-70d413149112 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:07.751406 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-893b2955-8d7c-4619-8ade-70d413149112 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:07.751834 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-893b2955-8d7c-4619-8ade-70d413149112 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:07.839428 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-8c00f161-6d68-4631-b176-8dd95dfcc803 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:07.840054 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-8c00f161-6d68-4631-b176-8dd95dfcc803 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:07.847069 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8c00f161-6d68-4631-b176-8dd95dfcc803 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:07.847513 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8c00f161-6d68-4631-b176-8dd95dfcc803 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:07.848277 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8c00f161-6d68-4631-b176-8dd95dfcc803 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:07.848742 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8c00f161-6d68-4631-b176-8dd95dfcc803 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:07.881898 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-893b2955-8d7c-4619-8ade-70d413149112 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:07.890060 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-893b2955-8d7c-4619-8ade-70d413149112 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1555 microversion: 2.1 time: 0.152586 May 23 17:23:07.890646 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 315/641] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:23:07 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:23:07.981623 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-8c00f161-6d68-4631-b176-8dd95dfcc803 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:07.989332 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-8c00f161-6d68-4631-b176-8dd95dfcc803 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1689 microversion: 2.1 time: 0.153793 May 23 17:23:07.989904 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 327/642] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:23:07 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:23:08.909562 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1d834112-9194-429e-8790-b3c26694ac7f tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:08.910165 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1d834112-9194-429e-8790-b3c26694ac7f tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:08.917462 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1d834112-9194-429e-8790-b3c26694ac7f tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:08.917966 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1d834112-9194-429e-8790-b3c26694ac7f tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:08.918808 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1d834112-9194-429e-8790-b3c26694ac7f tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:08.919246 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1d834112-9194-429e-8790-b3c26694ac7f tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:09.010201 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-bacf58bb-b8d7-4118-894a-aa975d9ee6db tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:09.010814 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-bacf58bb-b8d7-4118-894a-aa975d9ee6db tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:09.018338 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bacf58bb-b8d7-4118-894a-aa975d9ee6db tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:09.018810 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bacf58bb-b8d7-4118-894a-aa975d9ee6db tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:09.019547 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bacf58bb-b8d7-4118-894a-aa975d9ee6db tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:09.019977 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bacf58bb-b8d7-4118-894a-aa975d9ee6db tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:09.024234 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:23:09.053659 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1d834112-9194-429e-8790-b3c26694ac7f tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:09.061532 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1d834112-9194-429e-8790-b3c26694ac7f tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1555 microversion: 2.1 time: 0.156930 May 23 17:23:09.062154 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 316/643] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:23:08 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:23:09.152306 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-bacf58bb-b8d7-4118-894a-aa975d9ee6db tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:09.164436 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-bacf58bb-b8d7-4118-894a-aa975d9ee6db tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1689 microversion: 2.1 time: 0.157735 May 23 17:23:09.165248 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 328/644] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:23:09 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:23:09.744905 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-1863eeb7-fc29-4875-aa0b-3dc1f04c9445 req-68c14860-10b0-4766-afb3-1ccb789c2507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c6c849e-492f-4bd4-91d8-f1622420a3d2", "name": "network-vif-deleted", "tag": "b64de995-4ddd-4471-a42a-480203d490ce"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:23:09.753393 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-1863eeb7-fc29-4875-aa0b-3dc1f04c9445 req-68c14860-10b0-4766-afb3-1ccb789c2507 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:09.754054 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-1863eeb7-fc29-4875-aa0b-3dc1f04c9445 req-68c14860-10b0-4766-afb3-1ccb789c2507 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:09.766872 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-1863eeb7-fc29-4875-aa0b-3dc1f04c9445 req-68c14860-10b0-4766-afb3-1ccb789c2507 service nova] Creating event network-vif-deleted:b64de995-4ddd-4471-a42a-480203d490ce for instance 7c6c849e-492f-4bd4-91d8-f1622420a3d2 on hv-cinder-84299 May 23 17:23:09.773330 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-1863eeb7-fc29-4875-aa0b-3dc1f04c9445 req-68c14860-10b0-4766-afb3-1ccb789c2507 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031811 May 23 17:23:09.777402 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 317/645] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 17:23:10.078889 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-4ecf9852-eaa5-4172-b283-933c8cbf7a77 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:10.079502 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-4ecf9852-eaa5-4172-b283-933c8cbf7a77 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:10.086542 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4ecf9852-eaa5-4172-b283-933c8cbf7a77 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:10.086992 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4ecf9852-eaa5-4172-b283-933c8cbf7a77 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:10.087765 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4ecf9852-eaa5-4172-b283-933c8cbf7a77 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:10.088212 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4ecf9852-eaa5-4172-b283-933c8cbf7a77 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:10.122641 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4ecf9852-eaa5-4172-b283-933c8cbf7a77 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:10.123521 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4ecf9852-eaa5-4172-b283-933c8cbf7a77 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:10.124176 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.objects.instance [None req-4ecf9852-eaa5-4172-b283-933c8cbf7a77 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lazy-loading 'fault' on Instance uuid 7c6c849e-492f-4bd4-91d8-f1622420a3d2 {{(pid=117910) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 17:23:10.186028 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-23cdd33b-377e-4b98-96f4-200d23553a25 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:10.186802 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-23cdd33b-377e-4b98-96f4-200d23553a25 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:10.200963 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-23cdd33b-377e-4b98-96f4-200d23553a25 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:10.201902 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-23cdd33b-377e-4b98-96f4-200d23553a25 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:10.205103 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-23cdd33b-377e-4b98-96f4-200d23553a25 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:10.206007 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-23cdd33b-377e-4b98-96f4-200d23553a25 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:10.224983 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-4ecf9852-eaa5-4172-b283-933c8cbf7a77 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d18c022a19438d88562ef8e8c3fbce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc6a8ff9f92432ba9433b78a948d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:10.236958 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-4ecf9852-eaa5-4172-b283-933c8cbf7a77 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 200 len: 1348 microversion: 2.1 time: 0.161921 May 23 17:23:10.241343 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 329/646] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:23:10 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 1348 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:23:10.327075 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-23cdd33b-377e-4b98-96f4-200d23553a25 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:10.338596 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-23cdd33b-377e-4b98-96f4-200d23553a25 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 200 len: 1622 microversion: 2.1 time: 0.157449 May 23 17:23:10.340656 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 318/647] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:23:10 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 1622 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:23:10.441871 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-ccd1c5b3-59bf-4184-9168-9e00a5b70f6e req-96cce803-2003-4b3e-b185-dfabce999a6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c26b20b6-8a97-4aa1-af83-616cc09c9165", "name": "network-vif-deleted", "tag": "b66d0e22-835b-4627-b12b-de1e251bd6e9"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:23:10.450309 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-ccd1c5b3-59bf-4184-9168-9e00a5b70f6e req-96cce803-2003-4b3e-b185-dfabce999a6c service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:10.450745 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-ccd1c5b3-59bf-4184-9168-9e00a5b70f6e req-96cce803-2003-4b3e-b185-dfabce999a6c service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:10.462036 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-ccd1c5b3-59bf-4184-9168-9e00a5b70f6e req-96cce803-2003-4b3e-b185-dfabce999a6c service nova] Creating event network-vif-deleted:b66d0e22-835b-4627-b12b-de1e251bd6e9 for instance c26b20b6-8a97-4aa1-af83-616cc09c9165 on hv-cinder-84299 May 23 17:23:10.467460 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-ccd1c5b3-59bf-4184-9168-9e00a5b70f6e req-96cce803-2003-4b3e-b185-dfabce999a6c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.224577 May 23 17:23:10.468160 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 330/648] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:23:11.258753 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c85f7b0e-de01-44c7-8364-10b0061603a2 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:11.259462 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c85f7b0e-de01-44c7-8364-10b0061603a2 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] [instance: 7c6c849e-492f-4bd4-91d8-f1622420a3d2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:11.266795 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c85f7b0e-de01-44c7-8364-10b0061603a2 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:11.267243 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c85f7b0e-de01-44c7-8364-10b0061603a2 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:11.268048 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c85f7b0e-de01-44c7-8364-10b0061603a2 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:11.268480 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c85f7b0e-de01-44c7-8364-10b0061603a2 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:11.282163 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-c85f7b0e-de01-44c7-8364-10b0061603a2 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] HTTP exception thrown: Instance 7c6c849e-492f-4bd4-91d8-f1622420a3d2 could not be found. May 23 17:23:11.283799 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c85f7b0e-de01-44c7-8364-10b0061603a2 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Request method failure captured: May 23 17:23:11.283799 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: request: GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 HTTP/1.1 May 23 17:23:11.283799 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept: application/json May 23 17:23:11.283799 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity May 23 17:23:11.283799 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Connection: close May 23 17:23:11.283799 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Length: 0 May 23 17:23:11.283799 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Type: application/json May 23 17:23:11.283799 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Host: 10.222.0.46 May 23 17:23:11.283799 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None May 23 17:23:11.283799 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.9 May 23 17:23:11.283799 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABii8IhFLc5SRrlV46mzjIbDGi8ISLvoKZzsVY6GBFzbQRsbQ-CU16CLddG_CLpJHHxROrhbw8MDM7ET3F1Qk7V_AVXba-3YVGdPfnKZNHD84SJ5rzQ2N9rexy37gu7GMbLTXQsHp2F-A8Dk7TiW7bYR12hWEeSmOAEsTDJRuz0wQ2-B8Y May 23 17:23:11.283799 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Id: None May 23 17:23:11.283799 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Name: None May 23 17:23:11.283799 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed May 23 17:23:11.283799 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True May 23 17:23:11.283799 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default May 23 17:23:11.283799 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default May 23 17:23:11.283799 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Id: 0cc6a8ff9f92432ba9433b78a948d042 May 23 17:23:11.283799 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-TestMinimumBasicScenario-1725668553 May 23 17:23:11.283799 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Role: reader,member May 23 17:23:11.283799 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Roles: reader,member May 23 17:23:11.285478 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0cc6a8ff9f92432ba9433b78a948d042"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0cc6a8ff9f92432ba9433b78a948d042"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0cc6a8ff9f92432ba9433b78a948d042"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0cc6a8ff9f92432ba9433b78a948d042"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:23:11.285478 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-TestMinimumBasicScenario-1725668553 May 23 17:23:11.285478 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 0cc6a8ff9f92432ba9433b78a948d042 May 23 17:23:11.285478 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1725668553 May 23 17:23:11.285478 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User: tempest-TestMinimumBasicScenario-1725668553-project May 23 17:23:11.285478 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default May 23 17:23:11.285478 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default May 23 17:23:11.285478 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Id: 63d18c022a19438d88562ef8e8c3fbce May 23 17:23:11.285478 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-TestMinimumBasicScenario-1725668553-project May 23 17:23:11.285478 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: method: > May 23 17:23:11.285478 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: exception: Instance 7c6c849e-492f-4bd4-91d8-f1622420a3d2 could not be found. May 23 17:23:11.285478 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: action_args: {'id': '7c6c849e-492f-4bd4-91d8-f1622420a3d2'} May 23 17:23:11.287054 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:23:11.287054 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:23:11.287054 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:23:11.287054 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:23:11.287054 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:23:11.287054 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:23:11.287054 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:23:11.287054 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:23:11.287054 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:23:11.287054 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:23:11.287054 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c6c849e-492f-4bd4-91d8-f1622420a3d2 could not be found. May 23 17:23:11.287054 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:23:11.287054 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:23:11.287054 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:23:11.287054 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:23:11.287054 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:23:11.287054 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:23:11.287054 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:23:11.287054 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:23:11.287054 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:23:11.288557 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:23:11.288557 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 17:23:11.288557 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 17:23:11.288557 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:23:11.288557 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:23:11.288557 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:23:11.288557 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:23:11.288557 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c6c849e-492f-4bd4-91d8-f1622420a3d2 could not be found. May 23 17:23:11.288557 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:23:11.288557 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:23:11.288557 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:23:11.288557 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:23:11.288557 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:23:11.288557 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:23:11.288557 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:23:11.288557 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:23:11.288557 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c6c849e-492f-4bd4-91d8-f1622420a3d2 could not be found. May 23 17:23:11.288557 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:23:11.289728 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c85f7b0e-de01-44c7-8364-10b0061603a2 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Returning 404 to user: Instance 7c6c849e-492f-4bd4-91d8-f1622420a3d2 could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:23:11.289728 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c85f7b0e-de01-44c7-8364-10b0061603a2 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2" status: 404 len: 111 microversion: 2.1 time: 0.030501 May 23 17:23:11.289728 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 319/649] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:23:11 2022] GET /compute/v2.1/servers/7c6c849e-492f-4bd4-91d8-f1622420a3d2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:23:11.295214 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2a86c34f-857c-46d6-a2e0-b23cc720e308 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] Calling method '.version_select at 0x7fd7a0397820>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:11.319638 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2a86c34f-857c-46d6-a2e0-b23cc720e308 tempest-TestMinimumBasicScenario-1725668553 tempest-TestMinimumBasicScenario-1725668553-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1635307418" status: 202 len: 0 microversion: 2.1 time: 0.029194 May 23 17:23:11.323376 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 331/650] 10.222.0.46 () {58 vars in 1271 bytes} [Mon May 23 17:23:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1635307418 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 17:23:11.355104 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e1d4de52-2d4a-4e7c-ba3d-72872ff8ed4e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:11.355972 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e1d4de52-2d4a-4e7c-ba3d-72872ff8ed4e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: c26b20b6-8a97-4aa1-af83-616cc09c9165] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:11.368332 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e1d4de52-2d4a-4e7c-ba3d-72872ff8ed4e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:11.369156 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e1d4de52-2d4a-4e7c-ba3d-72872ff8ed4e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:11.369973 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e1d4de52-2d4a-4e7c-ba3d-72872ff8ed4e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:11.370404 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e1d4de52-2d4a-4e7c-ba3d-72872ff8ed4e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:11.384849 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-e1d4de52-2d4a-4e7c-ba3d-72872ff8ed4e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] HTTP exception thrown: Instance c26b20b6-8a97-4aa1-af83-616cc09c9165 could not be found. May 23 17:23:11.386572 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e1d4de52-2d4a-4e7c-ba3d-72872ff8ed4e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Request method failure captured: May 23 17:23:11.386572 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: request: GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 HTTP/1.1 May 23 17:23:11.386572 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept: application/json May 23 17:23:11.386572 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity May 23 17:23:11.386572 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Connection: close May 23 17:23:11.386572 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Length: 0 May 23 17:23:11.386572 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Type: application/json May 23 17:23:11.386572 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Host: 10.222.0.46 May 23 17:23:11.386572 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None May 23 17:23:11.386572 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.9 May 23 17:23:11.386572 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABii8HG0mgu4EO3OIfAaF2B3uvrt0HWl6redgiQ2amic5kI7hYTXFXsPdkkm5i1trVjfr7y7aQu40FrA_H1McTmt606JBABM6--n7E5dMGSGOv1HeOooMYCBiNeUywA0TG4sUNGbtPMRvIBMzMxwPFKuLlh0QtTh2yEErLoqKMT2s-W6-g May 23 17:23:11.386572 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Id: None May 23 17:23:11.386572 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Name: None May 23 17:23:11.386572 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed May 23 17:23:11.386572 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True May 23 17:23:11.386572 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default May 23 17:23:11.386572 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default May 23 17:23:11.386572 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Id: 9b1709bec893431599352cb6e470cf76 May 23 17:23:11.386572 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-407230310 May 23 17:23:11.386572 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Role: reader,member May 23 17:23:11.386572 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Roles: reader,member May 23 17:23:11.388339 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9b1709bec893431599352cb6e470cf76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9b1709bec893431599352cb6e470cf76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9b1709bec893431599352cb6e470cf76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9b1709bec893431599352cb6e470cf76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:23:11.388339 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-ServerRescueNegativeTestJSON-407230310 May 23 17:23:11.388339 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 9b1709bec893431599352cb6e470cf76 May 23 17:23:11.388339 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-407230310 May 23 17:23:11.388339 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User: tempest-ServerRescueNegativeTestJSON-407230310-project May 23 17:23:11.388339 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default May 23 17:23:11.388339 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default May 23 17:23:11.388339 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Id: 8c5d1f4f0bec40ad8e325f8f92739b4d May 23 17:23:11.388339 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-ServerRescueNegativeTestJSON-407230310-project May 23 17:23:11.388339 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: method: > May 23 17:23:11.388339 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: exception: Instance c26b20b6-8a97-4aa1-af83-616cc09c9165 could not be found. May 23 17:23:11.388339 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: action_args: {'id': 'c26b20b6-8a97-4aa1-af83-616cc09c9165'} May 23 17:23:11.389169 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:23:11.389169 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:23:11.389169 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:23:11.389169 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:23:11.389169 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:23:11.389169 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:23:11.389169 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:23:11.389169 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:23:11.389169 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:23:11.389169 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:23:11.389169 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c26b20b6-8a97-4aa1-af83-616cc09c9165 could not be found. May 23 17:23:11.389169 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:23:11.389169 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:23:11.389169 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:23:11.389169 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:23:11.389169 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:23:11.389169 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:23:11.389169 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:23:11.389169 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:23:11.389169 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:23:11.390375 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:23:11.390375 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 17:23:11.390375 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 17:23:11.390375 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:23:11.390375 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:23:11.390375 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:23:11.390375 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:23:11.390375 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c26b20b6-8a97-4aa1-af83-616cc09c9165 could not be found. May 23 17:23:11.390375 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:23:11.390375 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:23:11.390375 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:23:11.390375 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:23:11.390375 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:23:11.390375 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:23:11.390375 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:23:11.390375 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:23:11.390375 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c26b20b6-8a97-4aa1-af83-616cc09c9165 could not be found. May 23 17:23:11.390375 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:23:11.391566 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e1d4de52-2d4a-4e7c-ba3d-72872ff8ed4e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Returning 404 to user: Instance c26b20b6-8a97-4aa1-af83-616cc09c9165 could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:23:11.391566 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e1d4de52-2d4a-4e7c-ba3d-72872ff8ed4e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165" status: 404 len: 111 microversion: 2.1 time: 0.037105 May 23 17:23:11.391566 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 320/651] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:23:11 2022] GET /compute/v2.1/servers/c26b20b6-8a97-4aa1-af83-616cc09c9165 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:23:11.397620 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-122951b4-eb77-4e24-84f9-8acbcc9245aa tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '.version_select at 0x7fd7a04101f0>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:11.418721 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-122951b4-eb77-4e24-84f9-8acbcc9245aa tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1190045884" status: 202 len: 0 microversion: 2.1 time: 0.024944 May 23 17:23:11.419324 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 332/652] 10.222.0.46 () {58 vars in 1220 bytes} [Mon May 23 17:23:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1190045884 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 17:23:12.830186 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-91b80baa-09f9-47cf-abf9-2e5ddf8d8a0c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:12.830695 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-91b80baa-09f9-47cf-abf9-2e5ddf8d8a0c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:12.836953 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-91b80baa-09f9-47cf-abf9-2e5ddf8d8a0c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:12.837392 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-91b80baa-09f9-47cf-abf9-2e5ddf8d8a0c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:12.838143 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-91b80baa-09f9-47cf-abf9-2e5ddf8d8a0c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:12.838570 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-91b80baa-09f9-47cf-abf9-2e5ddf8d8a0c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:12.861820 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-91b80baa-09f9-47cf-abf9-2e5ddf8d8a0c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98/ips" status: 200 len: 151 microversion: 2.20 time: 0.147621 May 23 17:23:12.862375 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 321/653] 10.222.0.46 () {60 vars in 1288 bytes} [Mon May 23 17:23:12 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98/ips => generated 151 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 17:23:14.429635 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c9da62d3-00e7-45b9-8bde-55572f19a54f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:14.430388 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c9da62d3-00e7-45b9-8bde-55572f19a54f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:14.436826 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c9da62d3-00e7-45b9-8bde-55572f19a54f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:14.437357 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c9da62d3-00e7-45b9-8bde-55572f19a54f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:14.438213 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c9da62d3-00e7-45b9-8bde-55572f19a54f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:14.438704 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c9da62d3-00e7-45b9-8bde-55572f19a54f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:14.465116 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c9da62d3-00e7-45b9-8bde-55572f19a54f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Going to try to terminate instance {{(pid=117910) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 17:23:14.551438 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c9da62d3-00e7-45b9-8bde-55572f19a54f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "DELETE /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 204 len: 0 microversion: 2.1 time: 0.126446 May 23 17:23:14.555262 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 333/654] 10.222.0.46 () {58 vars in 1238 bytes} [Mon May 23 17:23:14 2022] DELETE /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 17:23:14.560616 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ba328184-0cab-4f11-9937-8ea837eecda5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:14.561261 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ba328184-0cab-4f11-9937-8ea837eecda5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:14.568145 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ba328184-0cab-4f11-9937-8ea837eecda5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:14.568578 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ba328184-0cab-4f11-9937-8ea837eecda5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:14.569528 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ba328184-0cab-4f11-9937-8ea837eecda5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:14.569966 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ba328184-0cab-4f11-9937-8ea837eecda5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:14.727412 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ba328184-0cab-4f11-9937-8ea837eecda5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:14.735759 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ba328184-0cab-4f11-9937-8ea837eecda5 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1508 microversion: 2.1 time: 0.179070 May 23 17:23:14.736345 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 322/655] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:23:14 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1508 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:23:15.640559 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-f132b48b-2d73-4536-84ff-38286435b966 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:23:15.641182 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-f132b48b-2d73-4536-84ff-38286435b966 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:15.648113 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f132b48b-2d73-4536-84ff-38286435b966 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:15.648576 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f132b48b-2d73-4536-84ff-38286435b966 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:15.649387 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f132b48b-2d73-4536-84ff-38286435b966 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:15.649830 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f132b48b-2d73-4536-84ff-38286435b966 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:15.675871 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.objects.instance [None req-f132b48b-2d73-4536-84ff-38286435b966 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lazy-loading 'flavor' on Instance uuid 549b0d88-0258-406c-90f1-fe4af4916e98 {{(pid=117910) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 17:23:15.753028 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6a80cc75-8ef2-49cc-a39e-d18355c2d3fb tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:15.753695 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6a80cc75-8ef2-49cc-a39e-d18355c2d3fb tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:15.764578 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6a80cc75-8ef2-49cc-a39e-d18355c2d3fb tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:15.765476 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6a80cc75-8ef2-49cc-a39e-d18355c2d3fb tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:15.773992 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6a80cc75-8ef2-49cc-a39e-d18355c2d3fb tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:15.774790 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6a80cc75-8ef2-49cc-a39e-d18355c2d3fb tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:15.917677 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6a80cc75-8ef2-49cc-a39e-d18355c2d3fb tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:15.927024 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6a80cc75-8ef2-49cc-a39e-d18355c2d3fb tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1508 microversion: 2.1 time: 0.177902 May 23 17:23:15.928063 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 323/656] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:23:15 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1508 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:23:15.956932 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-f132b48b-2d73-4536-84ff-38286435b966 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "POST /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98/action" status: 202 len: 0 microversion: 2.20 time: 0.321063 May 23 17:23:15.957612 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 334/657] 10.222.0.46 () {62 vars in 1318 bytes} [Mon May 23 17:23:15 2022] POST /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 17:23:15.965716 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-030aa3dd-3322-41b4-803b-8bcfe354ab53 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:15.966327 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-030aa3dd-3322-41b4-803b-8bcfe354ab53 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:15.972437 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-030aa3dd-3322-41b4-803b-8bcfe354ab53 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:15.972924 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-030aa3dd-3322-41b4-803b-8bcfe354ab53 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:15.973681 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-030aa3dd-3322-41b4-803b-8bcfe354ab53 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:15.974144 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-030aa3dd-3322-41b4-803b-8bcfe354ab53 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:16.107331 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-030aa3dd-3322-41b4-803b-8bcfe354ab53 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:16.115741 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-030aa3dd-3322-41b4-803b-8bcfe354ab53 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:16.117287 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-030aa3dd-3322-41b4-803b-8bcfe354ab53 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:16.118443 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-030aa3dd-3322-41b4-803b-8bcfe354ab53 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1722 microversion: 2.20 time: 0.156605 May 23 17:23:16.118977 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 324/658] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:23:15 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:23:16.945769 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-f5d5f677-be4d-4e1a-9383-a739232ed47f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:16.946464 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-f5d5f677-be4d-4e1a-9383-a739232ed47f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:16.952946 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f5d5f677-be4d-4e1a-9383-a739232ed47f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:16.953405 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f5d5f677-be4d-4e1a-9383-a739232ed47f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:16.954157 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f5d5f677-be4d-4e1a-9383-a739232ed47f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:16.954589 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f5d5f677-be4d-4e1a-9383-a739232ed47f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:17.137871 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b9e3fc29-0463-49fa-9290-f04762d222c5 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:17.139207 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b9e3fc29-0463-49fa-9290-f04762d222c5 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:17.146713 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b9e3fc29-0463-49fa-9290-f04762d222c5 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:17.147408 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b9e3fc29-0463-49fa-9290-f04762d222c5 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:17.148388 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b9e3fc29-0463-49fa-9290-f04762d222c5 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:17.149051 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b9e3fc29-0463-49fa-9290-f04762d222c5 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:17.169511 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-f5d5f677-be4d-4e1a-9383-a739232ed47f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:17.180829 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-f5d5f677-be4d-4e1a-9383-a739232ed47f tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1508 microversion: 2.1 time: 0.239651 May 23 17:23:17.181454 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 335/659] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:23:16 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1508 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:23:17.391775 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b9e3fc29-0463-49fa-9290-f04762d222c5 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:17.402307 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b9e3fc29-0463-49fa-9290-f04762d222c5 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:17.404629 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b9e3fc29-0463-49fa-9290-f04762d222c5 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:17.407022 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b9e3fc29-0463-49fa-9290-f04762d222c5 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1722 microversion: 2.20 time: 0.273165 May 23 17:23:17.407930 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 325/660] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:23:17 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1722 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 17:23:17.693344 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-08c67e8c-46d4-4d0a-9b45-a2726d24d8cf req-38918510-c72b-4058-883b-0e7173468880 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89495ce8-cbf1-4ac3-b7fa-a83360d167e2", "name": "network-vif-deleted", "tag": "fc870750-d842-4e16-9d01-cd2f38ced055"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:23:17.702429 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-08c67e8c-46d4-4d0a-9b45-a2726d24d8cf req-38918510-c72b-4058-883b-0e7173468880 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:17.703172 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-08c67e8c-46d4-4d0a-9b45-a2726d24d8cf req-38918510-c72b-4058-883b-0e7173468880 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:17.718449 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-08c67e8c-46d4-4d0a-9b45-a2726d24d8cf req-38918510-c72b-4058-883b-0e7173468880 service nova] Creating event network-vif-deleted:fc870750-d842-4e16-9d01-cd2f38ced055 for instance 89495ce8-cbf1-4ac3-b7fa-a83360d167e2 on hv-cinder-84299 May 23 17:23:17.724202 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-08c67e8c-46d4-4d0a-9b45-a2726d24d8cf req-38918510-c72b-4058-883b-0e7173468880 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034225 May 23 17:23:17.725129 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 336/661] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:23:18.198024 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-eb0f0678-4c9e-4b91-8478-58e770842621 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:18.199416 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-eb0f0678-4c9e-4b91-8478-58e770842621 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:18.206226 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eb0f0678-4c9e-4b91-8478-58e770842621 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:18.206915 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eb0f0678-4c9e-4b91-8478-58e770842621 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:18.207899 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eb0f0678-4c9e-4b91-8478-58e770842621 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:18.208492 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eb0f0678-4c9e-4b91-8478-58e770842621 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:18.242473 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eb0f0678-4c9e-4b91-8478-58e770842621 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:18.242934 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eb0f0678-4c9e-4b91-8478-58e770842621 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:18.243391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.objects.instance [None req-eb0f0678-4c9e-4b91-8478-58e770842621 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lazy-loading 'fault' on Instance uuid 89495ce8-cbf1-4ac3-b7fa-a83360d167e2 {{(pid=117909) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 17:23:18.300789 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-eb0f0678-4c9e-4b91-8478-58e770842621 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:18.307594 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-eb0f0678-4c9e-4b91-8478-58e770842621 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 200 len: 1311 microversion: 2.1 time: 0.113699 May 23 17:23:18.308176 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 326/662] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:23:18 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 1311 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:23:18.426737 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-69fff63f-da4e-40e9-aa87-a38230de99cd tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:18.427433 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-69fff63f-da4e-40e9-aa87-a38230de99cd tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:18.435051 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-69fff63f-da4e-40e9-aa87-a38230de99cd tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:18.435567 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-69fff63f-da4e-40e9-aa87-a38230de99cd tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:18.436236 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-69fff63f-da4e-40e9-aa87-a38230de99cd tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:18.436703 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-69fff63f-da4e-40e9-aa87-a38230de99cd tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:18.636434 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-69fff63f-da4e-40e9-aa87-a38230de99cd tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:18.645540 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-69fff63f-da4e-40e9-aa87-a38230de99cd tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:18.647068 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-69fff63f-da4e-40e9-aa87-a38230de99cd tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:18.648250 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-69fff63f-da4e-40e9-aa87-a38230de99cd tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1722 microversion: 2.20 time: 0.225795 May 23 17:23:18.648827 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 337/663] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:23:18 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:23:19.324929 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-448ad24b-0e07-4542-9503-55defce67487 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:19.325554 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-448ad24b-0e07-4542-9503-55defce67487 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: 89495ce8-cbf1-4ac3-b7fa-a83360d167e2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:19.332277 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-448ad24b-0e07-4542-9503-55defce67487 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:19.332745 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-448ad24b-0e07-4542-9503-55defce67487 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:19.333509 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-448ad24b-0e07-4542-9503-55defce67487 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:19.333938 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-448ad24b-0e07-4542-9503-55defce67487 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:19.347605 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-448ad24b-0e07-4542-9503-55defce67487 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] HTTP exception thrown: Instance 89495ce8-cbf1-4ac3-b7fa-a83360d167e2 could not be found. May 23 17:23:19.349349 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-448ad24b-0e07-4542-9503-55defce67487 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Request method failure captured: May 23 17:23:19.349349 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: request: GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 HTTP/1.1 May 23 17:23:19.349349 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept: application/json May 23 17:23:19.349349 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity May 23 17:23:19.349349 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Connection: close May 23 17:23:19.349349 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Length: 0 May 23 17:23:19.349349 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Type: application/json May 23 17:23:19.349349 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Host: 10.222.0.46 May 23 17:23:19.349349 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None May 23 17:23:19.349349 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.9 May 23 17:23:19.349349 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABii8HG0mgu4EO3OIfAaF2B3uvrt0HWl6redgiQ2amic5kI7hYTXFXsPdkkm5i1trVjfr7y7aQu40FrA_H1McTmt606JBABM6--n7E5dMGSGOv1HeOooMYCBiNeUywA0TG4sUNGbtPMRvIBMzMxwPFKuLlh0QtTh2yEErLoqKMT2s-W6-g May 23 17:23:19.349349 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Id: None May 23 17:23:19.349349 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Name: None May 23 17:23:19.349349 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed May 23 17:23:19.349349 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True May 23 17:23:19.349349 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default May 23 17:23:19.349349 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default May 23 17:23:19.349349 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Id: 9b1709bec893431599352cb6e470cf76 May 23 17:23:19.349349 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-407230310 May 23 17:23:19.349349 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Role: reader,member May 23 17:23:19.349349 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Roles: reader,member May 23 17:23:19.350681 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9b1709bec893431599352cb6e470cf76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9b1709bec893431599352cb6e470cf76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9b1709bec893431599352cb6e470cf76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9b1709bec893431599352cb6e470cf76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:23:19.350681 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-ServerRescueNegativeTestJSON-407230310 May 23 17:23:19.350681 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 9b1709bec893431599352cb6e470cf76 May 23 17:23:19.350681 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-407230310 May 23 17:23:19.350681 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User: tempest-ServerRescueNegativeTestJSON-407230310-project May 23 17:23:19.350681 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default May 23 17:23:19.350681 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default May 23 17:23:19.350681 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Id: 8c5d1f4f0bec40ad8e325f8f92739b4d May 23 17:23:19.350681 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-ServerRescueNegativeTestJSON-407230310-project May 23 17:23:19.350681 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: method: > May 23 17:23:19.350681 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: exception: Instance 89495ce8-cbf1-4ac3-b7fa-a83360d167e2 could not be found. May 23 17:23:19.350681 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: action_args: {'id': '89495ce8-cbf1-4ac3-b7fa-a83360d167e2'} May 23 17:23:19.351491 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:23:19.351491 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:23:19.351491 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:23:19.351491 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:23:19.351491 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:23:19.351491 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:23:19.351491 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:23:19.351491 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:23:19.351491 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:23:19.351491 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:23:19.351491 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89495ce8-cbf1-4ac3-b7fa-a83360d167e2 could not be found. May 23 17:23:19.351491 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:23:19.351491 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:23:19.351491 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:23:19.351491 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:23:19.351491 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:23:19.351491 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:23:19.351491 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:23:19.351491 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:23:19.351491 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:23:19.352701 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:23:19.352701 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 17:23:19.352701 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 17:23:19.352701 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:23:19.352701 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:23:19.352701 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:23:19.352701 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:23:19.352701 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89495ce8-cbf1-4ac3-b7fa-a83360d167e2 could not be found. May 23 17:23:19.352701 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:23:19.352701 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:23:19.352701 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:23:19.352701 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:23:19.352701 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:23:19.352701 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:23:19.352701 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:23:19.352701 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:23:19.352701 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89495ce8-cbf1-4ac3-b7fa-a83360d167e2 could not be found. May 23 17:23:19.352701 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:23:19.353856 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-448ad24b-0e07-4542-9503-55defce67487 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Returning 404 to user: Instance 89495ce8-cbf1-4ac3-b7fa-a83360d167e2 could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:23:19.353856 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-448ad24b-0e07-4542-9503-55defce67487 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2" status: 404 len: 111 microversion: 2.1 time: 0.029895 May 23 17:23:19.353856 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 327/664] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:23:19 2022] GET /compute/v2.1/servers/89495ce8-cbf1-4ac3-b7fa-a83360d167e2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:23:19.359736 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-8a4f2975-56c5-443c-b413-977d09658077 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:19.360235 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-8a4f2975-56c5-443c-b413-977d09658077 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: e7b61ab9-ad21-427d-a451-1f721fb3a84c] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:19.366288 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8a4f2975-56c5-443c-b413-977d09658077 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:19.366738 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8a4f2975-56c5-443c-b413-977d09658077 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:19.367516 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8a4f2975-56c5-443c-b413-977d09658077 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:19.367947 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8a4f2975-56c5-443c-b413-977d09658077 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:19.392904 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-8a4f2975-56c5-443c-b413-977d09658077 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: e7b61ab9-ad21-427d-a451-1f721fb3a84c] Going to try to terminate instance {{(pid=117910) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 17:23:19.483363 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-8a4f2975-56c5-443c-b413-977d09658077 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c" status: 204 len: 0 microversion: 2.1 time: 0.127204 May 23 17:23:19.484091 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 338/665] 10.222.0.46 () {58 vars in 1238 bytes} [Mon May 23 17:23:19 2022] DELETE /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 17:23:19.492292 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-739c8379-cee5-428a-8c2a-c82a45a6a1c6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:19.492992 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-739c8379-cee5-428a-8c2a-c82a45a6a1c6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: e7b61ab9-ad21-427d-a451-1f721fb3a84c] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:19.499363 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-739c8379-cee5-428a-8c2a-c82a45a6a1c6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:19.499897 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-739c8379-cee5-428a-8c2a-c82a45a6a1c6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:19.500799 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-739c8379-cee5-428a-8c2a-c82a45a6a1c6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:19.501308 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-739c8379-cee5-428a-8c2a-c82a45a6a1c6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:19.633818 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-739c8379-cee5-428a-8c2a-c82a45a6a1c6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:19.642959 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-739c8379-cee5-428a-8c2a-c82a45a6a1c6 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c" status: 200 len: 1522 microversion: 2.1 time: 0.154668 May 23 17:23:19.643707 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 328/666] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:23:19 2022] GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:23:19.666973 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-6a785dd3-915a-43ce-bcc8-d0a6edd609ce tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:19.667667 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-6a785dd3-915a-43ce-bcc8-d0a6edd609ce tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:19.673743 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6a785dd3-915a-43ce-bcc8-d0a6edd609ce tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:19.674193 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6a785dd3-915a-43ce-bcc8-d0a6edd609ce tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:19.674962 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6a785dd3-915a-43ce-bcc8-d0a6edd609ce tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:19.675393 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6a785dd3-915a-43ce-bcc8-d0a6edd609ce tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:19.838395 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-6a785dd3-915a-43ce-bcc8-d0a6edd609ce tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:19.847590 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-6a785dd3-915a-43ce-bcc8-d0a6edd609ce tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:19.849831 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-6a785dd3-915a-43ce-bcc8-d0a6edd609ce tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:19.850710 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-6a785dd3-915a-43ce-bcc8-d0a6edd609ce tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1722 microversion: 2.20 time: 0.188007 May 23 17:23:19.851610 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 339/667] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:23:19 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:23:20.661807 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ab9fc63c-fe73-4359-9cbe-fb185cc16e93 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:20.662499 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ab9fc63c-fe73-4359-9cbe-fb185cc16e93 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: e7b61ab9-ad21-427d-a451-1f721fb3a84c] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:20.669523 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ab9fc63c-fe73-4359-9cbe-fb185cc16e93 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:20.669971 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ab9fc63c-fe73-4359-9cbe-fb185cc16e93 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:20.670745 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ab9fc63c-fe73-4359-9cbe-fb185cc16e93 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:20.671188 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ab9fc63c-fe73-4359-9cbe-fb185cc16e93 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:20.800296 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ab9fc63c-fe73-4359-9cbe-fb185cc16e93 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:20.803817 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:23:20.808672 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ab9fc63c-fe73-4359-9cbe-fb185cc16e93 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c" status: 200 len: 1522 microversion: 2.1 time: 0.150701 May 23 17:23:20.809467 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 329/668] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:23:20 2022] GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:23:20.869388 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2f791fe4-448a-49e4-9c91-2e0c61c6ff2c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:20.870031 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2f791fe4-448a-49e4-9c91-2e0c61c6ff2c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:20.877049 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2f791fe4-448a-49e4-9c91-2e0c61c6ff2c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:20.877498 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2f791fe4-448a-49e4-9c91-2e0c61c6ff2c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:20.878264 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2f791fe4-448a-49e4-9c91-2e0c61c6ff2c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:20.878702 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2f791fe4-448a-49e4-9c91-2e0c61c6ff2c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:21.024200 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2f791fe4-448a-49e4-9c91-2e0c61c6ff2c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:21.036324 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2f791fe4-448a-49e4-9c91-2e0c61c6ff2c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:21.038728 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2f791fe4-448a-49e4-9c91-2e0c61c6ff2c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:21.040401 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2f791fe4-448a-49e4-9c91-2e0c61c6ff2c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1722 microversion: 2.20 time: 0.174797 May 23 17:23:21.041203 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 340/669] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:23:20 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:23:21.828153 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-40eb3b8f-42e3-4a09-94a3-6bdf25a4498e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:21.828793 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-40eb3b8f-42e3-4a09-94a3-6bdf25a4498e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: e7b61ab9-ad21-427d-a451-1f721fb3a84c] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:21.836086 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-40eb3b8f-42e3-4a09-94a3-6bdf25a4498e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:21.836545 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-40eb3b8f-42e3-4a09-94a3-6bdf25a4498e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:21.837332 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-40eb3b8f-42e3-4a09-94a3-6bdf25a4498e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:21.837763 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-40eb3b8f-42e3-4a09-94a3-6bdf25a4498e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:21.968802 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-40eb3b8f-42e3-4a09-94a3-6bdf25a4498e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:21.976471 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-40eb3b8f-42e3-4a09-94a3-6bdf25a4498e tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c" status: 200 len: 1522 microversion: 2.1 time: 0.152680 May 23 17:23:21.977082 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 330/670] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:23:21 2022] GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:23:22.061406 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2337408c-1aa2-41a9-8341-1f9c51fe628b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:22.062046 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2337408c-1aa2-41a9-8341-1f9c51fe628b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:22.069062 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2337408c-1aa2-41a9-8341-1f9c51fe628b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:22.069519 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2337408c-1aa2-41a9-8341-1f9c51fe628b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:22.070293 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2337408c-1aa2-41a9-8341-1f9c51fe628b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:22.070738 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2337408c-1aa2-41a9-8341-1f9c51fe628b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:22.204770 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2337408c-1aa2-41a9-8341-1f9c51fe628b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:22.217869 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2337408c-1aa2-41a9-8341-1f9c51fe628b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:22.220212 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2337408c-1aa2-41a9-8341-1f9c51fe628b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:22.221411 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2337408c-1aa2-41a9-8341-1f9c51fe628b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1722 microversion: 2.20 time: 0.164080 May 23 17:23:22.222012 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 341/671] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:23:22 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:23:22.697128 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-d9578ecd-d445-4ffd-b342-477ebb0af397 req-212f4c8c-526c-493f-94eb-2eb25a0993b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7b61ab9-ad21-427d-a451-1f721fb3a84c", "name": "network-vif-deleted", "tag": "29e82388-eff9-4236-8967-3fbfe96b21fa"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:23:22.706426 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-d9578ecd-d445-4ffd-b342-477ebb0af397 req-212f4c8c-526c-493f-94eb-2eb25a0993b6 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:22.706872 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-d9578ecd-d445-4ffd-b342-477ebb0af397 req-212f4c8c-526c-493f-94eb-2eb25a0993b6 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:22.718207 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-d9578ecd-d445-4ffd-b342-477ebb0af397 req-212f4c8c-526c-493f-94eb-2eb25a0993b6 service nova] Creating event network-vif-deleted:29e82388-eff9-4236-8967-3fbfe96b21fa for instance e7b61ab9-ad21-427d-a451-1f721fb3a84c on hv-cinder-84299 May 23 17:23:22.723532 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-d9578ecd-d445-4ffd-b342-477ebb0af397 req-212f4c8c-526c-493f-94eb-2eb25a0993b6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030095 May 23 17:23:22.724193 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 331/672] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:23:22.994023 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-38f063d0-774c-4ef7-9c69-e7cc2289fa3c tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:22.995005 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-38f063d0-774c-4ef7-9c69-e7cc2289fa3c tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: e7b61ab9-ad21-427d-a451-1f721fb3a84c] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:23.002105 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-38f063d0-774c-4ef7-9c69-e7cc2289fa3c tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:23.002555 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-38f063d0-774c-4ef7-9c69-e7cc2289fa3c tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:23.003340 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-38f063d0-774c-4ef7-9c69-e7cc2289fa3c tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:23.003774 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-38f063d0-774c-4ef7-9c69-e7cc2289fa3c tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:23.023000 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:23:23.038410 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-38f063d0-774c-4ef7-9c69-e7cc2289fa3c tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:23.038865 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-38f063d0-774c-4ef7-9c69-e7cc2289fa3c tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:23.039322 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.objects.instance [None req-38f063d0-774c-4ef7-9c69-e7cc2289fa3c tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lazy-loading 'fault' on Instance uuid e7b61ab9-ad21-427d-a451-1f721fb3a84c {{(pid=117910) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 17:23:23.082545 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-38f063d0-774c-4ef7-9c69-e7cc2289fa3c tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5d1f4f0bec40ad8e325f8f92739b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1709bec893431599352cb6e470cf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:23.090463 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-38f063d0-774c-4ef7-9c69-e7cc2289fa3c tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c" status: 200 len: 1312 microversion: 2.1 time: 0.100518 May 23 17:23:23.096743 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 342/673] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:23:22 2022] GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c => generated 1312 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:23:23.241747 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-cb0facd9-8388-484e-9a1c-d9b22c2a82f1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:23.242320 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-cb0facd9-8388-484e-9a1c-d9b22c2a82f1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:23.249025 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cb0facd9-8388-484e-9a1c-d9b22c2a82f1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:23.249469 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cb0facd9-8388-484e-9a1c-d9b22c2a82f1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:23.250228 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cb0facd9-8388-484e-9a1c-d9b22c2a82f1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:23.250669 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cb0facd9-8388-484e-9a1c-d9b22c2a82f1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:23.393523 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-cb0facd9-8388-484e-9a1c-d9b22c2a82f1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:23.404489 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-cb0facd9-8388-484e-9a1c-d9b22c2a82f1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:23.406905 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-cb0facd9-8388-484e-9a1c-d9b22c2a82f1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:23.408087 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-cb0facd9-8388-484e-9a1c-d9b22c2a82f1 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1722 microversion: 2.20 time: 0.171372 May 23 17:23:23.408638 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 332/674] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:23:23 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:23:24.111726 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-44bb2589-7c3f-43c4-b99b-dd9004bac102 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:24.112638 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-44bb2589-7c3f-43c4-b99b-dd9004bac102 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] [instance: e7b61ab9-ad21-427d-a451-1f721fb3a84c] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:24.119744 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-44bb2589-7c3f-43c4-b99b-dd9004bac102 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:24.120194 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-44bb2589-7c3f-43c4-b99b-dd9004bac102 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:24.121021 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-44bb2589-7c3f-43c4-b99b-dd9004bac102 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:24.121450 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-44bb2589-7c3f-43c4-b99b-dd9004bac102 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:24.135257 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-44bb2589-7c3f-43c4-b99b-dd9004bac102 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] HTTP exception thrown: Instance e7b61ab9-ad21-427d-a451-1f721fb3a84c could not be found. May 23 17:23:24.137412 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-44bb2589-7c3f-43c4-b99b-dd9004bac102 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Request method failure captured: May 23 17:23:24.137412 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: request: GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c HTTP/1.1 May 23 17:23:24.137412 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept: application/json May 23 17:23:24.137412 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity May 23 17:23:24.137412 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Connection: close May 23 17:23:24.137412 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Length: 0 May 23 17:23:24.137412 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Type: application/json May 23 17:23:24.137412 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Host: 10.222.0.46 May 23 17:23:24.137412 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None May 23 17:23:24.137412 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.9 May 23 17:23:24.137412 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABii8HG0mgu4EO3OIfAaF2B3uvrt0HWl6redgiQ2amic5kI7hYTXFXsPdkkm5i1trVjfr7y7aQu40FrA_H1McTmt606JBABM6--n7E5dMGSGOv1HeOooMYCBiNeUywA0TG4sUNGbtPMRvIBMzMxwPFKuLlh0QtTh2yEErLoqKMT2s-W6-g May 23 17:23:24.137412 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Id: None May 23 17:23:24.137412 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Name: None May 23 17:23:24.137412 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed May 23 17:23:24.137412 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True May 23 17:23:24.137412 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default May 23 17:23:24.137412 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default May 23 17:23:24.137412 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Id: 9b1709bec893431599352cb6e470cf76 May 23 17:23:24.137412 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-407230310 May 23 17:23:24.137412 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Role: reader,member May 23 17:23:24.137412 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Roles: reader,member May 23 17:23:24.138870 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9b1709bec893431599352cb6e470cf76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9b1709bec893431599352cb6e470cf76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9b1709bec893431599352cb6e470cf76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9b1709bec893431599352cb6e470cf76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:23:24.138870 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-ServerRescueNegativeTestJSON-407230310 May 23 17:23:24.138870 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 9b1709bec893431599352cb6e470cf76 May 23 17:23:24.138870 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-407230310 May 23 17:23:24.138870 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User: tempest-ServerRescueNegativeTestJSON-407230310-project May 23 17:23:24.138870 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default May 23 17:23:24.138870 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default May 23 17:23:24.138870 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Id: 8c5d1f4f0bec40ad8e325f8f92739b4d May 23 17:23:24.138870 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-ServerRescueNegativeTestJSON-407230310-project May 23 17:23:24.138870 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: method: > May 23 17:23:24.138870 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: exception: Instance e7b61ab9-ad21-427d-a451-1f721fb3a84c could not be found. May 23 17:23:24.138870 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: action_args: {'id': 'e7b61ab9-ad21-427d-a451-1f721fb3a84c'} May 23 17:23:24.139838 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:23:24.139838 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:23:24.139838 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:23:24.139838 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:23:24.139838 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:23:24.139838 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:23:24.139838 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:23:24.139838 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:23:24.139838 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:23:24.139838 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:23:24.139838 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7b61ab9-ad21-427d-a451-1f721fb3a84c could not be found. May 23 17:23:24.139838 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:23:24.139838 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:23:24.139838 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:23:24.139838 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:23:24.139838 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:23:24.139838 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:23:24.139838 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:23:24.139838 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:23:24.139838 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:23:24.141388 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:23:24.141388 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 17:23:24.141388 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 17:23:24.141388 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:23:24.141388 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:23:24.141388 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:23:24.141388 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:23:24.141388 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7b61ab9-ad21-427d-a451-1f721fb3a84c could not be found. May 23 17:23:24.141388 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:23:24.141388 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:23:24.141388 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:23:24.141388 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:23:24.141388 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:23:24.141388 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:23:24.141388 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:23:24.141388 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:23:24.141388 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7b61ab9-ad21-427d-a451-1f721fb3a84c could not be found. May 23 17:23:24.141388 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:23:24.142740 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-44bb2589-7c3f-43c4-b99b-dd9004bac102 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] Returning 404 to user: Instance e7b61ab9-ad21-427d-a451-1f721fb3a84c could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:23:24.142740 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-44bb2589-7c3f-43c4-b99b-dd9004bac102 tempest-ServerRescueNegativeTestJSON-407230310 tempest-ServerRescueNegativeTestJSON-407230310-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c" status: 404 len: 111 microversion: 2.1 time: 0.033759 May 23 17:23:24.142740 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 343/675] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:23:24 2022] GET /compute/v2.1/servers/e7b61ab9-ad21-427d-a451-1f721fb3a84c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:23:24.426645 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c42afc50-cfe2-460a-9b01-993f724b1cb3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:24.427449 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c42afc50-cfe2-460a-9b01-993f724b1cb3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:24.436191 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c42afc50-cfe2-460a-9b01-993f724b1cb3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:24.436640 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c42afc50-cfe2-460a-9b01-993f724b1cb3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:24.439611 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c42afc50-cfe2-460a-9b01-993f724b1cb3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:24.440061 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c42afc50-cfe2-460a-9b01-993f724b1cb3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:24.664240 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c42afc50-cfe2-460a-9b01-993f724b1cb3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:24.673740 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c42afc50-cfe2-460a-9b01-993f724b1cb3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:24.675655 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c42afc50-cfe2-460a-9b01-993f724b1cb3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:24.676875 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c42afc50-cfe2-460a-9b01-993f724b1cb3 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1722 microversion: 2.20 time: 0.254895 May 23 17:23:24.677453 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 333/676] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:23:24 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:23:25.694919 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2c5ea49c-cb43-45ba-bc3d-e5513bea7c01 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:25.695607 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2c5ea49c-cb43-45ba-bc3d-e5513bea7c01 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:25.702343 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2c5ea49c-cb43-45ba-bc3d-e5513bea7c01 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:25.702876 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2c5ea49c-cb43-45ba-bc3d-e5513bea7c01 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:25.703720 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2c5ea49c-cb43-45ba-bc3d-e5513bea7c01 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:25.704226 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2c5ea49c-cb43-45ba-bc3d-e5513bea7c01 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:25.860191 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2c5ea49c-cb43-45ba-bc3d-e5513bea7c01 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:25.869770 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2c5ea49c-cb43-45ba-bc3d-e5513bea7c01 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:25.871825 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2c5ea49c-cb43-45ba-bc3d-e5513bea7c01 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:25.873030 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2c5ea49c-cb43-45ba-bc3d-e5513bea7c01 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1722 microversion: 2.20 time: 0.182176 May 23 17:23:25.873641 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 344/677] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:23:25 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:23:26.891688 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-196d7bb8-b455-4948-8df4-81c3b169d819 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:26.892293 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-196d7bb8-b455-4948-8df4-81c3b169d819 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:26.899723 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-196d7bb8-b455-4948-8df4-81c3b169d819 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:26.900163 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-196d7bb8-b455-4948-8df4-81c3b169d819 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:26.900959 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-196d7bb8-b455-4948-8df4-81c3b169d819 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:26.901389 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-196d7bb8-b455-4948-8df4-81c3b169d819 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:27.027325 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-196d7bb8-b455-4948-8df4-81c3b169d819 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:27.035907 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-196d7bb8-b455-4948-8df4-81c3b169d819 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:27.037464 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-196d7bb8-b455-4948-8df4-81c3b169d819 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:27.038769 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-196d7bb8-b455-4948-8df4-81c3b169d819 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1722 microversion: 2.20 time: 0.151048 May 23 17:23:27.039427 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 334/678] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:23:26 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:23:28.057377 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-5a429a3e-510b-4c6f-9554-525360fe7c48 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:28.057989 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-5a429a3e-510b-4c6f-9554-525360fe7c48 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:28.064592 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5a429a3e-510b-4c6f-9554-525360fe7c48 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:28.065081 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5a429a3e-510b-4c6f-9554-525360fe7c48 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:28.065915 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5a429a3e-510b-4c6f-9554-525360fe7c48 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:28.066354 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5a429a3e-510b-4c6f-9554-525360fe7c48 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:28.196974 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-5a429a3e-510b-4c6f-9554-525360fe7c48 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:28.204919 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-5a429a3e-510b-4c6f-9554-525360fe7c48 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:28.206463 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-5a429a3e-510b-4c6f-9554-525360fe7c48 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:28.207604 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-5a429a3e-510b-4c6f-9554-525360fe7c48 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1743 microversion: 2.20 time: 0.154302 May 23 17:23:28.208168 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 345/679] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:23:28 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:23:29.230140 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3ebf1151-2781-4650-b61f-b9bf7f814ab8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:29.232150 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3ebf1151-2781-4650-b61f-b9bf7f814ab8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:29.243344 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3ebf1151-2781-4650-b61f-b9bf7f814ab8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:29.244291 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3ebf1151-2781-4650-b61f-b9bf7f814ab8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:29.245561 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3ebf1151-2781-4650-b61f-b9bf7f814ab8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:29.246771 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3ebf1151-2781-4650-b61f-b9bf7f814ab8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:29.787178 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3ebf1151-2781-4650-b61f-b9bf7f814ab8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:29.802417 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3ebf1151-2781-4650-b61f-b9bf7f814ab8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:29.803926 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3ebf1151-2781-4650-b61f-b9bf7f814ab8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:29.805163 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3ebf1151-2781-4650-b61f-b9bf7f814ab8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1738 microversion: 2.20 time: 0.581592 May 23 17:23:29.805730 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 335/680] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:23:29 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1738 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:23:30.825426 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-09ae5f12-62a8-4c95-b8d6-32b9239f66ac tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:30.826169 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-09ae5f12-62a8-4c95-b8d6-32b9239f66ac tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:30.846293 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-09ae5f12-62a8-4c95-b8d6-32b9239f66ac tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:30.848801 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-09ae5f12-62a8-4c95-b8d6-32b9239f66ac tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:30.852415 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-09ae5f12-62a8-4c95-b8d6-32b9239f66ac tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:30.853172 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-09ae5f12-62a8-4c95-b8d6-32b9239f66ac tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:31.251166 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-4715abd8-d0c6-4644-aea4-f3e4ec28c306 req-0b735645-d348-4012-a5c5-6c51d15a76f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "549b0d88-0258-406c-90f1-fe4af4916e98", "name": "network-vif-plugged", "status": "completed", "tag": "d71c640f-947d-49b7-9fa5-19acd7e88bcb"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:23:31.260335 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-09ae5f12-62a8-4c95-b8d6-32b9239f66ac tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:31.265883 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-4715abd8-d0c6-4644-aea4-f3e4ec28c306 req-0b735645-d348-4012-a5c5-6c51d15a76f5 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:31.266545 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-4715abd8-d0c6-4644-aea4-f3e4ec28c306 req-0b735645-d348-4012-a5c5-6c51d15a76f5 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:31.270195 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-09ae5f12-62a8-4c95-b8d6-32b9239f66ac tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:31.271710 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-09ae5f12-62a8-4c95-b8d6-32b9239f66ac tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:31.272911 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-09ae5f12-62a8-4c95-b8d6-32b9239f66ac tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1738 microversion: 2.20 time: 0.453451 May 23 17:23:31.286305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 346/681] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:23:30 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1738 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:23:31.294252 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-4715abd8-d0c6-4644-aea4-f3e4ec28c306 req-0b735645-d348-4012-a5c5-6c51d15a76f5 service nova] Creating event network-vif-plugged:d71c640f-947d-49b7-9fa5-19acd7e88bcb for instance 549b0d88-0258-406c-90f1-fe4af4916e98 on hv-cinder-84299 May 23 17:23:31.308363 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-4715abd8-d0c6-4644-aea4-f3e4ec28c306 req-0b735645-d348-4012-a5c5-6c51d15a76f5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.265868 May 23 17:23:31.311136 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 336/682] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 17:23:32.291439 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-648ee33c-1df4-4e46-8f2a-41f0fd1289b4 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:32.292048 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-648ee33c-1df4-4e46-8f2a-41f0fd1289b4 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:32.307857 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-648ee33c-1df4-4e46-8f2a-41f0fd1289b4 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:32.308647 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-648ee33c-1df4-4e46-8f2a-41f0fd1289b4 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:32.310743 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-648ee33c-1df4-4e46-8f2a-41f0fd1289b4 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:32.311901 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-648ee33c-1df4-4e46-8f2a-41f0fd1289b4 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:32.577699 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-648ee33c-1df4-4e46-8f2a-41f0fd1289b4 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:32.593992 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-648ee33c-1df4-4e46-8f2a-41f0fd1289b4 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:32.595823 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-648ee33c-1df4-4e46-8f2a-41f0fd1289b4 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:32.597324 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-648ee33c-1df4-4e46-8f2a-41f0fd1289b4 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1738 microversion: 2.20 time: 0.309853 May 23 17:23:32.609086 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 347/683] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:23:32 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1738 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:23:33.616001 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c4242a0c-6239-427b-a0c4-b0c601246e3d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:33.617332 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c4242a0c-6239-427b-a0c4-b0c601246e3d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:33.640333 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c4242a0c-6239-427b-a0c4-b0c601246e3d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:33.641051 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c4242a0c-6239-427b-a0c4-b0c601246e3d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:33.642375 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c4242a0c-6239-427b-a0c4-b0c601246e3d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:33.643043 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c4242a0c-6239-427b-a0c4-b0c601246e3d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:33.846205 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c4242a0c-6239-427b-a0c4-b0c601246e3d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:33.866535 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c4242a0c-6239-427b-a0c4-b0c601246e3d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:33.868914 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c4242a0c-6239-427b-a0c4-b0c601246e3d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:33.871331 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c4242a0c-6239-427b-a0c4-b0c601246e3d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1738 microversion: 2.20 time: 0.258796 May 23 17:23:33.872786 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 337/684] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:23:33 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1738 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:23:34.566916 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-415c41ae-25ff-4947-b74e-ef5dc437a7fe tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Action: 'create', calling method: .version_select at 0x7fd7a03d40d0>, body: {"keypair": {"name": "tempest-keypair-1139725027", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLEtwjUQ8nAlE+QBpvMioUvs53N8QDxKiiggyeYP20FFp/yTYdXGh3VkX4gM2gpvOxA5BuiR0RjwIfYgwmokrs8pap/pc4xl41YMLgLBz0F7uCQdI3n7CPiMoMzo62WNlw=="}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:23:34.577551 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:23:34.592470 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-415c41ae-25ff-4947-b74e-ef5dc437a7fe tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Getting quotas for project 054a5a15ef3c4200b1a78a890b077a53. Resources: {'key_pairs'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 17:23:34.597023 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-415c41ae-25ff-4947-b74e-ef5dc437a7fe tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Getting quotas for user 6943ae00467244228fa6ac90e48c4cce and project 054a5a15ef3c4200b1a78a890b077a53. Resources: {'key_pairs'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 17:23:34.630341 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-415c41ae-25ff-4947-b74e-ef5dc437a7fe tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.134089 May 23 17:23:34.631262 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 348/685] 10.222.0.46 () {60 vars in 1158 bytes} [Mon May 23 17:23:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:23:34.896689 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4eb82a69-7bd1-447d-98a2-053394a60c81 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:34.898118 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4eb82a69-7bd1-447d-98a2-053394a60c81 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:34.907646 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4eb82a69-7bd1-447d-98a2-053394a60c81 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:34.908581 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4eb82a69-7bd1-447d-98a2-053394a60c81 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:34.909549 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4eb82a69-7bd1-447d-98a2-053394a60c81 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:34.910142 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4eb82a69-7bd1-447d-98a2-053394a60c81 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:35.106121 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4eb82a69-7bd1-447d-98a2-053394a60c81 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:35.117846 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4eb82a69-7bd1-447d-98a2-053394a60c81 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:35.125455 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4eb82a69-7bd1-447d-98a2-053394a60c81 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:35.127758 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4eb82a69-7bd1-447d-98a2-053394a60c81 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1738 microversion: 2.20 time: 0.238933 May 23 17:23:35.128357 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 338/686] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:23:34 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1738 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 17:23:36.149065 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a9096779-71c9-45ec-9797-4b4897b62358 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:36.150492 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-a9096779-71c9-45ec-9797-4b4897b62358 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:36.160034 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a9096779-71c9-45ec-9797-4b4897b62358 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:36.160460 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a9096779-71c9-45ec-9797-4b4897b62358 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:36.169889 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a9096779-71c9-45ec-9797-4b4897b62358 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:36.170326 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a9096779-71c9-45ec-9797-4b4897b62358 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:36.350023 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a9096779-71c9-45ec-9797-4b4897b62358 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:36.368532 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a9096779-71c9-45ec-9797-4b4897b62358 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:36.372374 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-84ee5bd3-c817-4b27-9651-3426f2835beb tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1898297033", "imageRef": "99870172-61a4-4218-9407-6a6da3fb5c83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "86eea2f6-dd78-4689-a8d3-6c237bac4669"}], "security_groups": [{"name": "tempest-securitygroup--467663464"}], "key_name": "tempest-keypair-1139725027", "user_data": "}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:23:36.374478 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a9096779-71c9-45ec-9797-4b4897b62358 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:36.375784 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-a9096779-71c9-45ec-9797-4b4897b62358 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1738 microversion: 2.20 time: 0.231125 May 23 17:23:36.381574 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 349/687] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:23:36 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1738 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:23:36.492803 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.network.neutron [None req-84ee5bd3-c817-4b27-9651-3426f2835beb tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] validate_networks() for [('86eea2f6-dd78-4689-a8d3-6c237bac4669', None, None, None, None, None)] {{(pid=117909) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 17:23:37.035238 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-84ee5bd3-c817-4b27-9651-3426f2835beb tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Flavor limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 17:23:37.035656 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-84ee5bd3-c817-4b27-9651-3426f2835beb tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Image limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 17:23:37.036122 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-84ee5bd3-c817-4b27-9651-3426f2835beb tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Flavor pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 17:23:37.036531 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-84ee5bd3-c817-4b27-9651-3426f2835beb tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Image pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 17:23:37.036963 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-84ee5bd3-c817-4b27-9651-3426f2835beb tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 17:23:37.054722 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-84ee5bd3-c817-4b27-9651-3426f2835beb tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:37.055164 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-84ee5bd3-c817-4b27-9651-3426f2835beb tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:37.059783 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-84ee5bd3-c817-4b27-9651-3426f2835beb tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:37.060361 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-84ee5bd3-c817-4b27-9651-3426f2835beb tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:37.102225 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-84ee5bd3-c817-4b27-9651-3426f2835beb tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Getting quotas for project 054a5a15ef3c4200b1a78a890b077a53. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 17:23:37.115275 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-84ee5bd3-c817-4b27-9651-3426f2835beb tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Getting quotas for user 6943ae00467244228fa6ac90e48c4cce and project 054a5a15ef3c4200b1a78a890b077a53. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 17:23:37.149927 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-84ee5bd3-c817-4b27-9651-3426f2835beb tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Going to run 1 instances... {{(pid=117909) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 17:23:37.152265 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-84ee5bd3-c817-4b27-9651-3426f2835beb tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99870172-61a4-4218-9407-6a6da3fb5c83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 17:23:37.276209 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-84ee5bd3-c817-4b27-9651-3426f2835beb tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.907884 May 23 17:23:37.277574 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 339/688] 10.222.0.46 () {60 vars in 1146 bytes} [Mon May 23 17:23:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 23 17:23:37.287670 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-76f79a36-4036-479d-9da8-0a3159ceb6cf tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:37.289078 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-76f79a36-4036-479d-9da8-0a3159ceb6cf tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:37.407402 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-44a19a76-5017-47c1-a09b-c7b044f982b6 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:37.408837 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-44a19a76-5017-47c1-a09b-c7b044f982b6 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:37.426362 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-76f79a36-4036-479d-9da8-0a3159ceb6cf tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:37.435426 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-76f79a36-4036-479d-9da8-0a3159ceb6cf tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1238 microversion: 2.1 time: 0.151813 May 23 17:23:37.435739 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-44a19a76-5017-47c1-a09b-c7b044f982b6 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:37.436287 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-44a19a76-5017-47c1-a09b-c7b044f982b6 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:37.437217 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-44a19a76-5017-47c1-a09b-c7b044f982b6 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:37.437667 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-44a19a76-5017-47c1-a09b-c7b044f982b6 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:37.438965 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 350/689] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:23:37 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1238 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:23:37.641423 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-44a19a76-5017-47c1-a09b-c7b044f982b6 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:37.654165 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-44a19a76-5017-47c1-a09b-c7b044f982b6 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:37.656317 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-44a19a76-5017-47c1-a09b-c7b044f982b6 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:37.657999 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-44a19a76-5017-47c1-a09b-c7b044f982b6 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1738 microversion: 2.20 time: 0.256984 May 23 17:23:37.659456 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 340/690] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:23:37 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1738 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 17:23:38.457394 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a9edba07-8f22-40d6-9ff9-831219cc4726 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:38.458174 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-a9edba07-8f22-40d6-9ff9-831219cc4726 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:38.465849 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a9edba07-8f22-40d6-9ff9-831219cc4726 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:38.466755 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a9edba07-8f22-40d6-9ff9-831219cc4726 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:38.467783 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a9edba07-8f22-40d6-9ff9-831219cc4726 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:38.468512 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a9edba07-8f22-40d6-9ff9-831219cc4726 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:38.551373 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a9edba07-8f22-40d6-9ff9-831219cc4726 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:38.561496 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-a9edba07-8f22-40d6-9ff9-831219cc4726 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1290 microversion: 2.1 time: 0.109512 May 23 17:23:38.562787 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 351/691] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:23:38 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1290 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:23:38.677763 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a7e982c7-4dea-4966-949d-bfd7bd371cef tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:38.678840 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a7e982c7-4dea-4966-949d-bfd7bd371cef tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:38.681554 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:23:38.688335 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a7e982c7-4dea-4966-949d-bfd7bd371cef tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:38.689247 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a7e982c7-4dea-4966-949d-bfd7bd371cef tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:38.691639 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a7e982c7-4dea-4966-949d-bfd7bd371cef tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:38.692323 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a7e982c7-4dea-4966-949d-bfd7bd371cef tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:38.988268 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a7e982c7-4dea-4966-949d-bfd7bd371cef tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:39.000185 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a7e982c7-4dea-4966-949d-bfd7bd371cef tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:39.002464 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a7e982c7-4dea-4966-949d-bfd7bd371cef tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:39.004014 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a7e982c7-4dea-4966-949d-bfd7bd371cef tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1738 microversion: 2.20 time: 0.330699 May 23 17:23:39.016780 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 341/692] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:23:38 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1738 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:23:39.579514 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e29057bc-be66-49b2-971d-fcae9e29304f tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:39.580144 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-e29057bc-be66-49b2-971d-fcae9e29304f tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:39.593469 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e29057bc-be66-49b2-971d-fcae9e29304f tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:39.593922 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e29057bc-be66-49b2-971d-fcae9e29304f tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:39.594646 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e29057bc-be66-49b2-971d-fcae9e29304f tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:39.595086 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e29057bc-be66-49b2-971d-fcae9e29304f tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:39.863967 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e29057bc-be66-49b2-971d-fcae9e29304f tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:39.878086 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-e29057bc-be66-49b2-971d-fcae9e29304f tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1363 microversion: 2.1 time: 0.302463 May 23 17:23:39.879746 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 352/693] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:23:39 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1363 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:23:40.023162 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d7e5dd47-160f-420d-8216-1322858ef33a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:40.023980 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d7e5dd47-160f-420d-8216-1322858ef33a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:40.040038 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d7e5dd47-160f-420d-8216-1322858ef33a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:40.040504 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d7e5dd47-160f-420d-8216-1322858ef33a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:40.041342 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d7e5dd47-160f-420d-8216-1322858ef33a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:40.041797 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d7e5dd47-160f-420d-8216-1322858ef33a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:40.303006 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d7e5dd47-160f-420d-8216-1322858ef33a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:40.313891 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d7e5dd47-160f-420d-8216-1322858ef33a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:40.317094 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d7e5dd47-160f-420d-8216-1322858ef33a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:40.319050 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d7e5dd47-160f-420d-8216-1322858ef33a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1738 microversion: 2.20 time: 0.299841 May 23 17:23:40.319886 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 342/694] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:23:40 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1738 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:23:40.681677 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-6301a17c-472e-4b09-aba9-b35360b18f35 req-c36c0e82-8ab7-486d-be2c-b58a11c55aec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "566ee1b1-7455-4a79-84ad-a954fc6a6a96", "tag": "0b3502b6-a7d0-447b-8472-1ca6a83cc8cd"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:23:40.695346 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-6301a17c-472e-4b09-aba9-b35360b18f35 req-c36c0e82-8ab7-486d-be2c-b58a11c55aec service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:40.696095 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-6301a17c-472e-4b09-aba9-b35360b18f35 req-c36c0e82-8ab7-486d-be2c-b58a11c55aec service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:40.710706 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-6301a17c-472e-4b09-aba9-b35360b18f35 req-c36c0e82-8ab7-486d-be2c-b58a11c55aec service nova] Creating event network-changed:0b3502b6-a7d0-447b-8472-1ca6a83cc8cd for instance 566ee1b1-7455-4a79-84ad-a954fc6a6a96 on hv-cinder-84299 May 23 17:23:40.718183 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-6301a17c-472e-4b09-aba9-b35360b18f35 req-c36c0e82-8ab7-486d-be2c-b58a11c55aec service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047880 May 23 17:23:40.719245 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 353/695] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:23:40.895632 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-54fb995c-2824-464a-90fb-9cfb2dbdd2e9 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:40.896261 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-54fb995c-2824-464a-90fb-9cfb2dbdd2e9 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:40.902899 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-54fb995c-2824-464a-90fb-9cfb2dbdd2e9 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:40.903603 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-54fb995c-2824-464a-90fb-9cfb2dbdd2e9 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:40.904564 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-54fb995c-2824-464a-90fb-9cfb2dbdd2e9 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:40.905184 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-54fb995c-2824-464a-90fb-9cfb2dbdd2e9 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:41.143546 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-54fb995c-2824-464a-90fb-9cfb2dbdd2e9 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:41.154696 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-54fb995c-2824-464a-90fb-9cfb2dbdd2e9 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1363 microversion: 2.1 time: 0.262545 May 23 17:23:41.156034 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 343/696] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:23:40 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1363 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:23:41.342342 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-865da7eb-fc05-4376-a21d-03fc661a8920 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:41.344070 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-865da7eb-fc05-4376-a21d-03fc661a8920 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:41.353923 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-865da7eb-fc05-4376-a21d-03fc661a8920 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:41.354506 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-865da7eb-fc05-4376-a21d-03fc661a8920 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:41.355668 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-865da7eb-fc05-4376-a21d-03fc661a8920 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:41.356327 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-865da7eb-fc05-4376-a21d-03fc661a8920 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:41.498140 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-865da7eb-fc05-4376-a21d-03fc661a8920 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:41.506368 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-865da7eb-fc05-4376-a21d-03fc661a8920 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:41.507886 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-865da7eb-fc05-4376-a21d-03fc661a8920 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:41.509061 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-865da7eb-fc05-4376-a21d-03fc661a8920 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1738 microversion: 2.20 time: 0.173416 May 23 17:23:41.509671 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 354/697] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:23:41 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:23:42.182034 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-652f8ecb-60e6-452f-8176-53e67d23900b tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:42.182656 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-652f8ecb-60e6-452f-8176-53e67d23900b tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:42.191914 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-652f8ecb-60e6-452f-8176-53e67d23900b tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:42.192365 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-652f8ecb-60e6-452f-8176-53e67d23900b tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:42.193192 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-652f8ecb-60e6-452f-8176-53e67d23900b tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:42.193633 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-652f8ecb-60e6-452f-8176-53e67d23900b tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:42.337165 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-652f8ecb-60e6-452f-8176-53e67d23900b tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:42.344997 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-652f8ecb-60e6-452f-8176-53e67d23900b tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1363 microversion: 2.1 time: 0.168978 May 23 17:23:42.345578 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 344/698] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:23:42 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:23:42.528007 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-caf8c8f7-45c9-4640-afd9-4235eb67021f tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:42.528691 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-caf8c8f7-45c9-4640-afd9-4235eb67021f tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:42.536125 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-caf8c8f7-45c9-4640-afd9-4235eb67021f tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:42.536637 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-caf8c8f7-45c9-4640-afd9-4235eb67021f tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:42.537551 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-caf8c8f7-45c9-4640-afd9-4235eb67021f tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:42.538096 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-caf8c8f7-45c9-4640-afd9-4235eb67021f tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:42.958599 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-caf8c8f7-45c9-4640-afd9-4235eb67021f tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:42.967087 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-caf8c8f7-45c9-4640-afd9-4235eb67021f tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:42.968772 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-caf8c8f7-45c9-4640-afd9-4235eb67021f tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:42.970186 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-caf8c8f7-45c9-4640-afd9-4235eb67021f tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1720 microversion: 2.20 time: 0.446041 May 23 17:23:42.970809 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 355/699] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:23:42 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1720 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:23:43.366343 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-161c35de-7fd6-4060-8e92-f6d96734f07f tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:43.366886 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-161c35de-7fd6-4060-8e92-f6d96734f07f tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:43.374411 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-161c35de-7fd6-4060-8e92-f6d96734f07f tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:43.374905 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-161c35de-7fd6-4060-8e92-f6d96734f07f tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:43.375754 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-161c35de-7fd6-4060-8e92-f6d96734f07f tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:43.376233 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-161c35de-7fd6-4060-8e92-f6d96734f07f tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:43.515836 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-161c35de-7fd6-4060-8e92-f6d96734f07f tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:43.523693 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-161c35de-7fd6-4060-8e92-f6d96734f07f tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1363 microversion: 2.1 time: 0.163989 May 23 17:23:43.524243 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 345/700] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:23:43 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:23:43.991237 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-f114552a-1808-4e1c-905b-473765c88eba tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:43.991835 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-f114552a-1808-4e1c-905b-473765c88eba tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:43.998845 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f114552a-1808-4e1c-905b-473765c88eba tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:43.999266 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f114552a-1808-4e1c-905b-473765c88eba tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:44.000076 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f114552a-1808-4e1c-905b-473765c88eba tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:44.000514 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f114552a-1808-4e1c-905b-473765c88eba tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:44.132974 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-f114552a-1808-4e1c-905b-473765c88eba tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:44.142326 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-f114552a-1808-4e1c-905b-473765c88eba tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:44.143826 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-f114552a-1808-4e1c-905b-473765c88eba tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:44.145027 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-f114552a-1808-4e1c-905b-473765c88eba tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1720 microversion: 2.20 time: 0.159066 May 23 17:23:44.145597 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 356/701] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:23:43 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:23:44.541651 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-64cf4e14-b2af-4bf3-b40a-7ac830bcaca4 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:44.542281 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-64cf4e14-b2af-4bf3-b40a-7ac830bcaca4 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:44.548994 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-64cf4e14-b2af-4bf3-b40a-7ac830bcaca4 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:44.549455 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-64cf4e14-b2af-4bf3-b40a-7ac830bcaca4 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:44.550226 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-64cf4e14-b2af-4bf3-b40a-7ac830bcaca4 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:44.550669 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-64cf4e14-b2af-4bf3-b40a-7ac830bcaca4 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:44.683436 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-64cf4e14-b2af-4bf3-b40a-7ac830bcaca4 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:44.693035 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-64cf4e14-b2af-4bf3-b40a-7ac830bcaca4 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1363 microversion: 2.1 time: 0.155882 May 23 17:23:44.693599 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 346/702] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:23:44 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:23:45.165323 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-f375fd10-ee02-4c1a-8f93-4e17dd62a07d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:45.165904 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-f375fd10-ee02-4c1a-8f93-4e17dd62a07d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:45.173544 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f375fd10-ee02-4c1a-8f93-4e17dd62a07d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:45.173991 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f375fd10-ee02-4c1a-8f93-4e17dd62a07d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:45.174775 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f375fd10-ee02-4c1a-8f93-4e17dd62a07d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:45.175210 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f375fd10-ee02-4c1a-8f93-4e17dd62a07d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:45.311447 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-f375fd10-ee02-4c1a-8f93-4e17dd62a07d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:45.321241 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-f375fd10-ee02-4c1a-8f93-4e17dd62a07d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:45.323311 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-f375fd10-ee02-4c1a-8f93-4e17dd62a07d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:45.325317 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-f375fd10-ee02-4c1a-8f93-4e17dd62a07d tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1663 microversion: 2.20 time: 0.164825 May 23 17:23:45.325865 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 357/703] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:23:45 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1663 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:23:45.344285 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-da8837c5-b6e0-4c3d-9daf-4c3492296d62 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb05191c-166d-420a-8888-67938319998b"}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:23:45.345466 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-da8837c5-b6e0-4c3d-9daf-4c3492296d62 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:45.351893 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-da8837c5-b6e0-4c3d-9daf-4c3492296d62 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:45.352353 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-da8837c5-b6e0-4c3d-9daf-4c3492296d62 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:45.353220 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-da8837c5-b6e0-4c3d-9daf-4c3492296d62 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:45.353628 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-da8837c5-b6e0-4c3d-9daf-4c3492296d62 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:45.529905 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:23:45.637202 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-da8837c5-b6e0-4c3d-9daf-4c3492296d62 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "POST /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.296677 May 23 17:23:45.638038 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 347/704] 10.222.0.46 () {62 vars in 1363 bytes} [Mon May 23 17:23:45 2022] POST /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98/os-volume_attachments => generated 188 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 17:23:45.712027 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c3eb2193-4827-415b-a7ca-6f265c9ba145 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:45.712832 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c3eb2193-4827-415b-a7ca-6f265c9ba145 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:45.718947 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c3eb2193-4827-415b-a7ca-6f265c9ba145 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:45.719391 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c3eb2193-4827-415b-a7ca-6f265c9ba145 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:45.720191 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c3eb2193-4827-415b-a7ca-6f265c9ba145 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:45.720648 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c3eb2193-4827-415b-a7ca-6f265c9ba145 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:45.761506 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-fd44bfee-5b05-4b96-9351-dfcc6e14df06 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:45.762373 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-fd44bfee-5b05-4b96-9351-dfcc6e14df06 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:45.768549 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fd44bfee-5b05-4b96-9351-dfcc6e14df06 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:45.769035 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fd44bfee-5b05-4b96-9351-dfcc6e14df06 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:45.769891 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fd44bfee-5b05-4b96-9351-dfcc6e14df06 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:45.770328 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fd44bfee-5b05-4b96-9351-dfcc6e14df06 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:45.853182 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-c3eb2193-4827-415b-a7ca-6f265c9ba145 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:45.861267 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c3eb2193-4827-415b-a7ca-6f265c9ba145 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1363 microversion: 2.1 time: 0.154070 May 23 17:23:45.861896 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 358/705] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:23:45 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:23:46.000558 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-fd44bfee-5b05-4b96-9351-dfcc6e14df06 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "DELETE /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98/os-volume_attachments/fb05191c-166d-420a-8888-67938319998b" status: 202 len: 0 microversion: 2.20 time: 0.243109 May 23 17:23:46.001205 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 348/706] 10.222.0.46 () {60 vars in 1456 bytes} [Mon May 23 17:23:45 2022] DELETE /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98/os-volume_attachments/fb05191c-166d-420a-8888-67938319998b => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 17:23:46.058168 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b120c662-cea9-4ee4-bcef-2cd55d3d1c38 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:23:46.058724 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-b120c662-cea9-4ee4-bcef-2cd55d3d1c38 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:46.065124 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b120c662-cea9-4ee4-bcef-2cd55d3d1c38 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:46.065574 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b120c662-cea9-4ee4-bcef-2cd55d3d1c38 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:46.066329 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b120c662-cea9-4ee4-bcef-2cd55d3d1c38 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:46.066761 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b120c662-cea9-4ee4-bcef-2cd55d3d1c38 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:46.202089 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b120c662-cea9-4ee4-bcef-2cd55d3d1c38 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "POST /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98/action" status: 202 len: 0 microversion: 2.20 time: 0.147765 May 23 17:23:46.202769 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 359/707] 10.222.0.46 () {62 vars in 1318 bytes} [Mon May 23 17:23:46 2022] POST /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 17:23:46.213267 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5fc145a5-f6ba-4abe-9375-0b40284e1a69 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:46.214341 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5fc145a5-f6ba-4abe-9375-0b40284e1a69 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:46.222699 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5fc145a5-f6ba-4abe-9375-0b40284e1a69 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:46.223327 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5fc145a5-f6ba-4abe-9375-0b40284e1a69 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:46.224399 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5fc145a5-f6ba-4abe-9375-0b40284e1a69 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:46.225042 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5fc145a5-f6ba-4abe-9375-0b40284e1a69 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:46.356338 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5fc145a5-f6ba-4abe-9375-0b40284e1a69 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:46.365002 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5fc145a5-f6ba-4abe-9375-0b40284e1a69 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:46.366577 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5fc145a5-f6ba-4abe-9375-0b40284e1a69 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:46.367727 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5fc145a5-f6ba-4abe-9375-0b40284e1a69 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1671 microversion: 2.20 time: 0.160547 May 23 17:23:46.368289 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 349/708] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:23:46 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:23:46.879216 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c165f447-4a63-4f3d-9e29-632f72dfafca tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:46.879912 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c165f447-4a63-4f3d-9e29-632f72dfafca tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:46.886184 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c165f447-4a63-4f3d-9e29-632f72dfafca tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:46.886592 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c165f447-4a63-4f3d-9e29-632f72dfafca tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:46.887649 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c165f447-4a63-4f3d-9e29-632f72dfafca tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:46.888092 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c165f447-4a63-4f3d-9e29-632f72dfafca tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:46.990981 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-a9906858-4b3b-47a0-9592-01741820c36f req-44843249-3d2b-4959-8e7d-96a45b89c0a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "566ee1b1-7455-4a79-84ad-a954fc6a6a96", "name": "network-vif-plugged", "status": "completed", "tag": "0b3502b6-a7d0-447b-8472-1ca6a83cc8cd"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:23:47.001357 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-a9906858-4b3b-47a0-9592-01741820c36f req-44843249-3d2b-4959-8e7d-96a45b89c0a3 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:47.001849 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-a9906858-4b3b-47a0-9592-01741820c36f req-44843249-3d2b-4959-8e7d-96a45b89c0a3 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:47.015908 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-a9906858-4b3b-47a0-9592-01741820c36f req-44843249-3d2b-4959-8e7d-96a45b89c0a3 service nova] Creating event network-vif-plugged:0b3502b6-a7d0-447b-8472-1ca6a83cc8cd for instance 566ee1b1-7455-4a79-84ad-a954fc6a6a96 on hv-cinder-84299 May 23 17:23:47.021681 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-a9906858-4b3b-47a0-9592-01741820c36f req-44843249-3d2b-4959-8e7d-96a45b89c0a3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035013 May 23 17:23:47.022546 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 350/709] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:23:47.056750 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-c165f447-4a63-4f3d-9e29-632f72dfafca tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:47.070095 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c165f447-4a63-4f3d-9e29-632f72dfafca tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1363 microversion: 2.1 time: 0.194943 May 23 17:23:47.071064 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 360/710] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:23:46 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:23:47.384988 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=2 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:23:47.385843 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=6 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:23:47.391204 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ee6243ab-4614-4540-b27e-c5929c20d837 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:47.391928 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ee6243ab-4614-4540-b27e-c5929c20d837 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:47.399801 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ee6243ab-4614-4540-b27e-c5929c20d837 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:47.400305 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ee6243ab-4614-4540-b27e-c5929c20d837 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:47.401209 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ee6243ab-4614-4540-b27e-c5929c20d837 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:47.401826 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ee6243ab-4614-4540-b27e-c5929c20d837 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:47.535824 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ee6243ab-4614-4540-b27e-c5929c20d837 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:47.543973 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ee6243ab-4614-4540-b27e-c5929c20d837 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:47.545503 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ee6243ab-4614-4540-b27e-c5929c20d837 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:47.546669 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ee6243ab-4614-4540-b27e-c5929c20d837 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1729 microversion: 2.20 time: 0.162902 May 23 17:23:47.547232 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 351/711] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:23:47 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:23:48.087215 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-016fd892-6044-4a98-aeb3-6ad266cace4c tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:48.087963 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-016fd892-6044-4a98-aeb3-6ad266cace4c tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:48.090387 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=6 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:23:48.095965 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-016fd892-6044-4a98-aeb3-6ad266cace4c tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:48.096492 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-016fd892-6044-4a98-aeb3-6ad266cace4c tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:48.097381 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-016fd892-6044-4a98-aeb3-6ad266cace4c tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:48.097884 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-016fd892-6044-4a98-aeb3-6ad266cace4c tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:48.106834 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:23:48.243699 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-016fd892-6044-4a98-aeb3-6ad266cace4c tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:48.251208 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-016fd892-6044-4a98-aeb3-6ad266cace4c tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1363 microversion: 2.1 time: 0.167953 May 23 17:23:48.251785 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 361/712] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:23:48 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:23:48.570740 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1adbd73b-e172-4928-b725-71f8ebd623a5 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:48.571746 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1adbd73b-e172-4928-b725-71f8ebd623a5 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:48.582343 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1adbd73b-e172-4928-b725-71f8ebd623a5 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:48.583194 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1adbd73b-e172-4928-b725-71f8ebd623a5 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:48.584641 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1adbd73b-e172-4928-b725-71f8ebd623a5 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:48.585095 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1adbd73b-e172-4928-b725-71f8ebd623a5 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:48.731342 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1adbd73b-e172-4928-b725-71f8ebd623a5 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:48.741966 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1adbd73b-e172-4928-b725-71f8ebd623a5 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:48.743467 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1adbd73b-e172-4928-b725-71f8ebd623a5 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:48.744628 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1adbd73b-e172-4928-b725-71f8ebd623a5 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1729 microversion: 2.20 time: 0.181499 May 23 17:23:48.745205 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 352/713] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:23:48 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:23:49.068855 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-a40fbec7-913d-4628-b80f-9b2a1ac3e41f req-1d9eaddc-a44d-4539-8fb1-70c29793fbfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "549b0d88-0258-406c-90f1-fe4af4916e98", "name": "network-vif-unplugged", "status": "completed", "tag": "d71c640f-947d-49b7-9fa5-19acd7e88bcb"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:23:49.077353 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-a40fbec7-913d-4628-b80f-9b2a1ac3e41f req-1d9eaddc-a44d-4539-8fb1-70c29793fbfe service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:49.077798 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-a40fbec7-913d-4628-b80f-9b2a1ac3e41f req-1d9eaddc-a44d-4539-8fb1-70c29793fbfe service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:49.091060 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-a40fbec7-913d-4628-b80f-9b2a1ac3e41f req-1d9eaddc-a44d-4539-8fb1-70c29793fbfe service nova] Creating event network-vif-unplugged:d71c640f-947d-49b7-9fa5-19acd7e88bcb for instance 549b0d88-0258-406c-90f1-fe4af4916e98 on hv-cinder-84299 May 23 17:23:49.096316 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-a40fbec7-913d-4628-b80f-9b2a1ac3e41f req-1d9eaddc-a44d-4539-8fb1-70c29793fbfe service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031332 May 23 17:23:49.096947 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 362/714] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:23:49.268003 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-56510256-2407-43b7-9a80-83b67716dfe0 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:49.268751 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-56510256-2407-43b7-9a80-83b67716dfe0 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:49.275250 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-56510256-2407-43b7-9a80-83b67716dfe0 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:49.275700 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-56510256-2407-43b7-9a80-83b67716dfe0 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:49.276463 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-56510256-2407-43b7-9a80-83b67716dfe0 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:49.276927 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-56510256-2407-43b7-9a80-83b67716dfe0 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:49.422005 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-56510256-2407-43b7-9a80-83b67716dfe0 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:49.430082 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-56510256-2407-43b7-9a80-83b67716dfe0 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1549 microversion: 2.1 time: 0.166040 May 23 17:23:49.430858 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 353/715] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:23:49 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1549 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:23:49.447496 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e6430bf6-c4ef-4127-8ee3-4ca37b7b018c tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:49.448072 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-e6430bf6-c4ef-4127-8ee3-4ca37b7b018c tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:49.454877 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e6430bf6-c4ef-4127-8ee3-4ca37b7b018c tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:49.455322 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e6430bf6-c4ef-4127-8ee3-4ca37b7b018c tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:49.456080 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e6430bf6-c4ef-4127-8ee3-4ca37b7b018c tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:49.456510 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e6430bf6-c4ef-4127-8ee3-4ca37b7b018c tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:49.535138 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-e6430bf6-c4ef-4127-8ee3-4ca37b7b018c tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091843 May 23 17:23:49.536112 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 363/716] 10.222.0.46 () {58 vars in 1274 bytes} [Mon May 23 17:23:49 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:23:49.762523 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c5afff0f-f7f6-439e-8f1c-35731dc9d3de tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:49.763128 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c5afff0f-f7f6-439e-8f1c-35731dc9d3de tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:49.772703 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c5afff0f-f7f6-439e-8f1c-35731dc9d3de tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:49.773409 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c5afff0f-f7f6-439e-8f1c-35731dc9d3de tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:49.774382 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c5afff0f-f7f6-439e-8f1c-35731dc9d3de tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:49.775188 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c5afff0f-f7f6-439e-8f1c-35731dc9d3de tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:49.962266 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c5afff0f-f7f6-439e-8f1c-35731dc9d3de tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:49.971649 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c5afff0f-f7f6-439e-8f1c-35731dc9d3de tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:49.977504 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c5afff0f-f7f6-439e-8f1c-35731dc9d3de tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:49.982344 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c5afff0f-f7f6-439e-8f1c-35731dc9d3de tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1729 microversion: 2.20 time: 0.224054 May 23 17:23:49.983127 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 354/717] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:23:49 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1729 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:23:50.748179 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-7e0df547-4ef0-4e9e-bb3a-cb5029d0093a req-a10253f0-5169-4fb3-aec0-dcbd3405f75d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "566ee1b1-7455-4a79-84ad-a954fc6a6a96", "tag": "0b3502b6-a7d0-447b-8472-1ca6a83cc8cd"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:23:50.761213 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-7e0df547-4ef0-4e9e-bb3a-cb5029d0093a req-a10253f0-5169-4fb3-aec0-dcbd3405f75d service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:50.762443 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-7e0df547-4ef0-4e9e-bb3a-cb5029d0093a req-a10253f0-5169-4fb3-aec0-dcbd3405f75d service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:50.778867 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-7e0df547-4ef0-4e9e-bb3a-cb5029d0093a req-a10253f0-5169-4fb3-aec0-dcbd3405f75d service nova] Creating event network-changed:0b3502b6-a7d0-447b-8472-1ca6a83cc8cd for instance 566ee1b1-7455-4a79-84ad-a954fc6a6a96 on hv-cinder-84299 May 23 17:23:50.791694 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-7e0df547-4ef0-4e9e-bb3a-cb5029d0093a req-a10253f0-5169-4fb3-aec0-dcbd3405f75d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115959 May 23 17:23:50.792318 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 364/718] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 17:23:51.005181 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-720cedca-b205-4317-a501-7b43398e69a6 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:51.005801 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-720cedca-b205-4317-a501-7b43398e69a6 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:51.013081 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-720cedca-b205-4317-a501-7b43398e69a6 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:51.013536 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-720cedca-b205-4317-a501-7b43398e69a6 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:51.014315 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-720cedca-b205-4317-a501-7b43398e69a6 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:51.014780 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-720cedca-b205-4317-a501-7b43398e69a6 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:51.157578 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-720cedca-b205-4317-a501-7b43398e69a6 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:51.167784 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-720cedca-b205-4317-a501-7b43398e69a6 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:51.169716 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-720cedca-b205-4317-a501-7b43398e69a6 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:51.171126 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-720cedca-b205-4317-a501-7b43398e69a6 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1729 microversion: 2.20 time: 0.169902 May 23 17:23:51.184935 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 355/719] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:23:51 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:23:52.204850 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-aa72527a-e4dd-42f6-b5f0-f45bfa06578a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:52.206210 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-aa72527a-e4dd-42f6-b5f0-f45bfa06578a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:52.214152 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-aa72527a-e4dd-42f6-b5f0-f45bfa06578a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:52.214701 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-aa72527a-e4dd-42f6-b5f0-f45bfa06578a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:52.215496 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-aa72527a-e4dd-42f6-b5f0-f45bfa06578a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:52.215927 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-aa72527a-e4dd-42f6-b5f0-f45bfa06578a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:52.363948 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-aa72527a-e4dd-42f6-b5f0-f45bfa06578a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:52.372676 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-aa72527a-e4dd-42f6-b5f0-f45bfa06578a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:52.374698 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-aa72527a-e4dd-42f6-b5f0-f45bfa06578a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:52.376073 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-aa72527a-e4dd-42f6-b5f0-f45bfa06578a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1729 microversion: 2.20 time: 0.176143 May 23 17:23:52.383045 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 365/720] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:23:52 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:23:53.395558 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c8f6bf9d-a18a-42ac-ab8d-b369a9f400da tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:53.397219 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c8f6bf9d-a18a-42ac-ab8d-b369a9f400da tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:53.404933 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c8f6bf9d-a18a-42ac-ab8d-b369a9f400da tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:53.405797 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c8f6bf9d-a18a-42ac-ab8d-b369a9f400da tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:53.406739 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c8f6bf9d-a18a-42ac-ab8d-b369a9f400da tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:53.407211 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c8f6bf9d-a18a-42ac-ab8d-b369a9f400da tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:53.557250 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c8f6bf9d-a18a-42ac-ab8d-b369a9f400da tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:53.565617 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c8f6bf9d-a18a-42ac-ab8d-b369a9f400da tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:53.567125 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c8f6bf9d-a18a-42ac-ab8d-b369a9f400da tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:53.568302 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c8f6bf9d-a18a-42ac-ab8d-b369a9f400da tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1729 microversion: 2.20 time: 0.177086 May 23 17:23:53.569106 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 356/721] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:23:53 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:23:54.587644 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-80f32873-c4dd-441a-9d94-fc18aa383c01 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:54.588206 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-80f32873-c4dd-441a-9d94-fc18aa383c01 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:54.595003 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-80f32873-c4dd-441a-9d94-fc18aa383c01 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:54.595451 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-80f32873-c4dd-441a-9d94-fc18aa383c01 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:54.596223 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-80f32873-c4dd-441a-9d94-fc18aa383c01 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:54.596683 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-80f32873-c4dd-441a-9d94-fc18aa383c01 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:54.737690 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-80f32873-c4dd-441a-9d94-fc18aa383c01 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:54.746122 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-80f32873-c4dd-441a-9d94-fc18aa383c01 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:54.747621 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-80f32873-c4dd-441a-9d94-fc18aa383c01 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:54.748880 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-80f32873-c4dd-441a-9d94-fc18aa383c01 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1729 microversion: 2.20 time: 0.165265 May 23 17:23:54.749390 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 366/722] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:23:54 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:23:55.768481 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-db8055c6-9dc3-43f4-a012-85020b5f9ba8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:55.769294 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-db8055c6-9dc3-43f4-a012-85020b5f9ba8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:55.780254 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-db8055c6-9dc3-43f4-a012-85020b5f9ba8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:55.780956 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-db8055c6-9dc3-43f4-a012-85020b5f9ba8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:55.782051 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-db8055c6-9dc3-43f4-a012-85020b5f9ba8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:55.782599 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-db8055c6-9dc3-43f4-a012-85020b5f9ba8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:55.936042 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-db8055c6-9dc3-43f4-a012-85020b5f9ba8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:55.946018 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-db8055c6-9dc3-43f4-a012-85020b5f9ba8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:55.947878 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-db8055c6-9dc3-43f4-a012-85020b5f9ba8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:55.949252 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-db8055c6-9dc3-43f4-a012-85020b5f9ba8 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1729 microversion: 2.20 time: 0.185951 May 23 17:23:55.950251 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 357/723] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:23:55 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1729 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:23:56.971832 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-db32b42c-020d-4b19-a5e5-a1d6d7da557b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:56.973093 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-db32b42c-020d-4b19-a5e5-a1d6d7da557b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:56.983445 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-db32b42c-020d-4b19-a5e5-a1d6d7da557b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:56.984130 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-db32b42c-020d-4b19-a5e5-a1d6d7da557b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:56.985304 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-db32b42c-020d-4b19-a5e5-a1d6d7da557b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:56.985850 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-db32b42c-020d-4b19-a5e5-a1d6d7da557b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:57.131245 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-db32b42c-020d-4b19-a5e5-a1d6d7da557b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:57.139985 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-db32b42c-020d-4b19-a5e5-a1d6d7da557b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:57.141543 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-db32b42c-020d-4b19-a5e5-a1d6d7da557b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:57.142697 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-db32b42c-020d-4b19-a5e5-a1d6d7da557b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1729 microversion: 2.20 time: 0.178490 May 23 17:23:57.143253 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 367/724] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:23:56 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:23:58.161194 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8eea99b6-199d-428c-a058-02ac8bcc37e2 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:58.161768 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8eea99b6-199d-428c-a058-02ac8bcc37e2 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:58.168631 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8eea99b6-199d-428c-a058-02ac8bcc37e2 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:58.169092 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8eea99b6-199d-428c-a058-02ac8bcc37e2 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:58.169852 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8eea99b6-199d-428c-a058-02ac8bcc37e2 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:58.170281 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8eea99b6-199d-428c-a058-02ac8bcc37e2 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:58.337110 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8eea99b6-199d-428c-a058-02ac8bcc37e2 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:58.345639 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8eea99b6-199d-428c-a058-02ac8bcc37e2 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:58.347155 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8eea99b6-199d-428c-a058-02ac8bcc37e2 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:58.348328 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8eea99b6-199d-428c-a058-02ac8bcc37e2 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1729 microversion: 2.20 time: 0.191156 May 23 17:23:58.348950 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 358/725] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:23:58 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1729 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:23:59.367103 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-7b88cdc4-850b-4a7a-bfc0-72892cc94b65 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:23:59.367711 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-7b88cdc4-850b-4a7a-bfc0-72892cc94b65 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:23:59.374398 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7b88cdc4-850b-4a7a-bfc0-72892cc94b65 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:59.374844 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7b88cdc4-850b-4a7a-bfc0-72892cc94b65 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:59.375603 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7b88cdc4-850b-4a7a-bfc0-72892cc94b65 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:23:59.376029 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7b88cdc4-850b-4a7a-bfc0-72892cc94b65 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:23:59.511066 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-7b88cdc4-850b-4a7a-bfc0-72892cc94b65 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:59.519643 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-7b88cdc4-850b-4a7a-bfc0-72892cc94b65 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:59.521163 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-7b88cdc4-850b-4a7a-bfc0-72892cc94b65 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:23:59.522314 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-7b88cdc4-850b-4a7a-bfc0-72892cc94b65 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1729 microversion: 2.20 time: 0.159206 May 23 17:23:59.522875 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 368/726] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:23:59 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:24:00.548631 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-15cbd92e-4e3f-466c-90ef-cfe8cb436976 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:00.549440 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-15cbd92e-4e3f-466c-90ef-cfe8cb436976 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:00.557761 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-15cbd92e-4e3f-466c-90ef-cfe8cb436976 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:00.558208 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-15cbd92e-4e3f-466c-90ef-cfe8cb436976 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:00.558982 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-15cbd92e-4e3f-466c-90ef-cfe8cb436976 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:00.559416 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-15cbd92e-4e3f-466c-90ef-cfe8cb436976 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:00.706940 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-15cbd92e-4e3f-466c-90ef-cfe8cb436976 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:00.715653 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-15cbd92e-4e3f-466c-90ef-cfe8cb436976 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:00.717199 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-15cbd92e-4e3f-466c-90ef-cfe8cb436976 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:00.718355 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-15cbd92e-4e3f-466c-90ef-cfe8cb436976 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1729 microversion: 2.20 time: 0.175116 May 23 17:24:00.718926 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 359/727] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:24:00 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:24:01.741082 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-188b84f7-44e3-4b86-be10-6c463da903aa tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:01.742087 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-188b84f7-44e3-4b86-be10-6c463da903aa tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:01.753051 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-188b84f7-44e3-4b86-be10-6c463da903aa tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:01.753795 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-188b84f7-44e3-4b86-be10-6c463da903aa tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:01.755053 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-188b84f7-44e3-4b86-be10-6c463da903aa tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:01.755770 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-188b84f7-44e3-4b86-be10-6c463da903aa tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:01.890255 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-188b84f7-44e3-4b86-be10-6c463da903aa tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:01.898616 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-188b84f7-44e3-4b86-be10-6c463da903aa tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:01.900131 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-188b84f7-44e3-4b86-be10-6c463da903aa tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:01.901460 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-188b84f7-44e3-4b86-be10-6c463da903aa tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1729 microversion: 2.20 time: 0.166943 May 23 17:24:01.902031 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 369/728] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:24:01 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:24:02.922829 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8427feb6-7371-4852-9c4f-8d55a77e0326 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:02.923540 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8427feb6-7371-4852-9c4f-8d55a77e0326 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:02.935088 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8427feb6-7371-4852-9c4f-8d55a77e0326 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:02.935613 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8427feb6-7371-4852-9c4f-8d55a77e0326 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:02.937182 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8427feb6-7371-4852-9c4f-8d55a77e0326 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:02.938106 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8427feb6-7371-4852-9c4f-8d55a77e0326 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:03.071387 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8427feb6-7371-4852-9c4f-8d55a77e0326 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:03.073715 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=4,nova_cell1:UPDATE=7 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:24:03.080844 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8427feb6-7371-4852-9c4f-8d55a77e0326 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:03.082527 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8427feb6-7371-4852-9c4f-8d55a77e0326 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:03.083736 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8427feb6-7371-4852-9c4f-8d55a77e0326 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1729 microversion: 2.20 time: 0.167445 May 23 17:24:03.084359 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 360/729] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:24:02 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:24:03.093913 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-ca4b1a2f-bec8-4d30-b57e-600d223f70c5 req-4fbbfcfd-4069-4e41-bdba-5f7d2bc121e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "549b0d88-0258-406c-90f1-fe4af4916e98", "name": "network-vif-plugged", "status": "completed", "tag": "d71c640f-947d-49b7-9fa5-19acd7e88bcb"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:24:03.102693 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-ca4b1a2f-bec8-4d30-b57e-600d223f70c5 req-4fbbfcfd-4069-4e41-bdba-5f7d2bc121e6 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:03.103248 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-ca4b1a2f-bec8-4d30-b57e-600d223f70c5 req-4fbbfcfd-4069-4e41-bdba-5f7d2bc121e6 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:03.116843 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-ca4b1a2f-bec8-4d30-b57e-600d223f70c5 req-4fbbfcfd-4069-4e41-bdba-5f7d2bc121e6 service nova] Creating event network-vif-plugged:d71c640f-947d-49b7-9fa5-19acd7e88bcb for instance 549b0d88-0258-406c-90f1-fe4af4916e98 on hv-cinder-84299 May 23 17:24:03.121931 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-ca4b1a2f-bec8-4d30-b57e-600d223f70c5 req-4fbbfcfd-4069-4e41-bdba-5f7d2bc121e6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031842 May 23 17:24:03.122744 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 370/730] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:24:04.104547 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3b1582d1-9b48-4932-984b-f501b637bcd5 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:04.105173 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3b1582d1-9b48-4932-984b-f501b637bcd5 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:04.113296 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3b1582d1-9b48-4932-984b-f501b637bcd5 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:04.113747 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3b1582d1-9b48-4932-984b-f501b637bcd5 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:04.114524 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3b1582d1-9b48-4932-984b-f501b637bcd5 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:04.114974 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3b1582d1-9b48-4932-984b-f501b637bcd5 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:04.253333 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3b1582d1-9b48-4932-984b-f501b637bcd5 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:04.262460 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3b1582d1-9b48-4932-984b-f501b637bcd5 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:04.264245 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3b1582d1-9b48-4932-984b-f501b637bcd5 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:04.265451 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3b1582d1-9b48-4932-984b-f501b637bcd5 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1729 microversion: 2.20 time: 0.165889 May 23 17:24:04.266039 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 361/731] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:24:04 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:24:05.289439 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e5cac8d4-7877-42f5-a646-5150a4d5fc73 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:05.290394 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-e5cac8d4-7877-42f5-a646-5150a4d5fc73 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:05.293492 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:24:05.302535 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e5cac8d4-7877-42f5-a646-5150a4d5fc73 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:05.303269 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e5cac8d4-7877-42f5-a646-5150a4d5fc73 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:05.304531 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e5cac8d4-7877-42f5-a646-5150a4d5fc73 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:05.305320 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e5cac8d4-7877-42f5-a646-5150a4d5fc73 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:05.602598 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e5cac8d4-7877-42f5-a646-5150a4d5fc73 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:05.611073 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e5cac8d4-7877-42f5-a646-5150a4d5fc73 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:05.612586 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e5cac8d4-7877-42f5-a646-5150a4d5fc73 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:05.613776 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-e5cac8d4-7877-42f5-a646-5150a4d5fc73 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1716 microversion: 2.20 time: 0.332410 May 23 17:24:05.614322 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 371/732] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:24:05 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1716 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:24:26.643749 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-baa0c2f6-827b-4bc4-b7bb-17d7b03c8169 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:26.644442 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-baa0c2f6-827b-4bc4-b7bb-17d7b03c8169 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:26.646919 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=41 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:24:26.647669 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=7 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:24:26.655141 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-baa0c2f6-827b-4bc4-b7bb-17d7b03c8169 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:26.655663 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-baa0c2f6-827b-4bc4-b7bb-17d7b03c8169 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:26.656569 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-baa0c2f6-827b-4bc4-b7bb-17d7b03c8169 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:26.657104 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-baa0c2f6-827b-4bc4-b7bb-17d7b03c8169 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:26.682785 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-baa0c2f6-827b-4bc4-b7bb-17d7b03c8169 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96/ips" status: 200 len: 146 microversion: 2.1 time: 0.044904 May 23 17:24:26.683339 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 362/733] 10.222.0.46 () {58 vars in 1247 bytes} [Mon May 23 17:24:26 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96/ips => generated 146 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:24:28.981578 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-caf1c667-d877-4deb-873c-99d4e1bf1ba1 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1abb710b-3a0e-491d-8365-569b260f1453"}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:24:28.982706 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-caf1c667-d877-4deb-873c-99d4e1bf1ba1 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:28.984760 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=1 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:24:28.985377 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=50 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:24:28.991844 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-caf1c667-d877-4deb-873c-99d4e1bf1ba1 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:28.992517 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-caf1c667-d877-4deb-873c-99d4e1bf1ba1 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:28.993822 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-caf1c667-d877-4deb-873c-99d4e1bf1ba1 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:28.994538 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-caf1c667-d877-4deb-873c-99d4e1bf1ba1 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:29.257106 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-caf1c667-d877-4deb-873c-99d4e1bf1ba1 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "POST /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279450 May 23 17:24:29.257843 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 372/734] 10.222.0.46 () {60 vars in 1322 bytes} [Mon May 23 17:24:28 2022] POST /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:24:35.742539 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5e98fe65-92bb-423c-a345-d9bd593e4623 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:24:35.749428 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5e98fe65-92bb-423c-a345-d9bd593e4623 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:35.749933 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5e98fe65-92bb-423c-a345-d9bd593e4623 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:35.820115 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5e98fe65-92bb-423c-a345-d9bd593e4623 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Going to try to stop instance {{(pid=117909) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 23 17:24:35.872129 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5e98fe65-92bb-423c-a345-d9bd593e4623 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "POST /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96/action" status: 202 len: 0 microversion: 2.1 time: 0.133337 May 23 17:24:35.872854 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 363/735] 10.222.0.46 () {60 vars in 1277 bytes} [Mon May 23 17:24:35 2022] POST /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 17:24:35.881536 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d05e86df-e1a5-43af-a849-038d14685d56 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:35.882257 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d05e86df-e1a5-43af-a849-038d14685d56 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:35.889755 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d05e86df-e1a5-43af-a849-038d14685d56 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:35.890204 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d05e86df-e1a5-43af-a849-038d14685d56 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:35.891023 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d05e86df-e1a5-43af-a849-038d14685d56 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:35.891457 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d05e86df-e1a5-43af-a849-038d14685d56 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:36.019332 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d05e86df-e1a5-43af-a849-038d14685d56 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:36.027493 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d05e86df-e1a5-43af-a849-038d14685d56 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1724 microversion: 2.1 time: 0.150095 May 23 17:24:36.028057 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 373/736] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:24:35 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:24:37.051317 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a6c5f6f3-48d3-4b40-b466-a7eaf6390cf1 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:37.052355 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a6c5f6f3-48d3-4b40-b466-a7eaf6390cf1 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:37.063069 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a6c5f6f3-48d3-4b40-b466-a7eaf6390cf1 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:37.063815 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a6c5f6f3-48d3-4b40-b466-a7eaf6390cf1 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:37.065147 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a6c5f6f3-48d3-4b40-b466-a7eaf6390cf1 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:37.065873 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a6c5f6f3-48d3-4b40-b466-a7eaf6390cf1 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:37.206813 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a6c5f6f3-48d3-4b40-b466-a7eaf6390cf1 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:37.215255 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a6c5f6f3-48d3-4b40-b466-a7eaf6390cf1 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1724 microversion: 2.1 time: 0.172369 May 23 17:24:37.215826 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 364/737] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:24:37 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:24:38.138904 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b7c4e94d-4763-43c6-b4e5-70705894618a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:38.140018 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-b7c4e94d-4763-43c6-b4e5-70705894618a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:38.146593 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b7c4e94d-4763-43c6-b4e5-70705894618a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:38.147038 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b7c4e94d-4763-43c6-b4e5-70705894618a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:38.147793 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b7c4e94d-4763-43c6-b4e5-70705894618a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:38.148231 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b7c4e94d-4763-43c6-b4e5-70705894618a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:38.176464 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b7c4e94d-4763-43c6-b4e5-70705894618a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041889 May 23 17:24:38.177051 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 374/738] 10.222.0.46 () {60 vars in 1342 bytes} [Mon May 23 17:24:38 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:24:38.233044 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-eaab385b-5f65-4079-ae05-2e2068865730 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:38.233678 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-eaab385b-5f65-4079-ae05-2e2068865730 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:38.236212 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-5b3c9807-f29b-42ea-bae1-f7909868777a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:38.236736 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-5b3c9807-f29b-42ea-bae1-f7909868777a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:38.240347 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eaab385b-5f65-4079-ae05-2e2068865730 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:38.240847 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eaab385b-5f65-4079-ae05-2e2068865730 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:38.241611 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eaab385b-5f65-4079-ae05-2e2068865730 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:38.242041 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eaab385b-5f65-4079-ae05-2e2068865730 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:38.242810 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5b3c9807-f29b-42ea-bae1-f7909868777a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:38.243259 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5b3c9807-f29b-42ea-bae1-f7909868777a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:38.244110 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5b3c9807-f29b-42ea-bae1-f7909868777a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:38.244535 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5b3c9807-f29b-42ea-bae1-f7909868777a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:38.269355 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-5b3c9807-f29b-42ea-bae1-f7909868777a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Going to try to terminate instance {{(pid=117910) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 17:24:38.350700 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-5b3c9807-f29b-42ea-bae1-f7909868777a tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "DELETE /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 204 len: 0 microversion: 2.20 time: 0.117861 May 23 17:24:38.351233 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 375/739] 10.222.0.46 () {60 vars in 1279 bytes} [Mon May 23 17:24:38 2022] DELETE /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 23 17:24:38.361008 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-48a16960-8e2f-43a9-9509-6f538a431ce4 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:38.361789 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-48a16960-8e2f-43a9-9509-6f538a431ce4 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:38.367732 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-48a16960-8e2f-43a9-9509-6f538a431ce4 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:38.368173 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-48a16960-8e2f-43a9-9509-6f538a431ce4 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:38.369007 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-48a16960-8e2f-43a9-9509-6f538a431ce4 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:38.369435 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-48a16960-8e2f-43a9-9509-6f538a431ce4 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:38.373844 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-eaab385b-5f65-4079-ae05-2e2068865730 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:38.381992 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-eaab385b-5f65-4079-ae05-2e2068865730 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1724 microversion: 2.1 time: 0.153219 May 23 17:24:38.382572 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 365/740] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:24:38 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:24:38.521404 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-48a16960-8e2f-43a9-9509-6f538a431ce4 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:38.533936 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-48a16960-8e2f-43a9-9509-6f538a431ce4 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:38.536263 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-48a16960-8e2f-43a9-9509-6f538a431ce4 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:38.538059 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-48a16960-8e2f-43a9-9509-6f538a431ce4 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1722 microversion: 2.20 time: 0.181296 May 23 17:24:38.538777 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 376/741] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:24:38 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 17:24:39.400414 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b6c50e43-80ce-4d7f-ae19-0d9adce99cfe tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:39.401028 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b6c50e43-80ce-4d7f-ae19-0d9adce99cfe tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:39.408587 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b6c50e43-80ce-4d7f-ae19-0d9adce99cfe tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:39.409125 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b6c50e43-80ce-4d7f-ae19-0d9adce99cfe tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:39.410016 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b6c50e43-80ce-4d7f-ae19-0d9adce99cfe tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:39.410519 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b6c50e43-80ce-4d7f-ae19-0d9adce99cfe tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:39.543280 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b6c50e43-80ce-4d7f-ae19-0d9adce99cfe tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:39.551309 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b6c50e43-80ce-4d7f-ae19-0d9adce99cfe tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1724 microversion: 2.1 time: 0.155462 May 23 17:24:39.551888 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 366/742] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:24:39 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:24:39.557003 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e4155faa-ac94-4606-91cd-9691e7cf457b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:39.557617 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-e4155faa-ac94-4606-91cd-9691e7cf457b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:39.564326 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e4155faa-ac94-4606-91cd-9691e7cf457b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:39.564822 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e4155faa-ac94-4606-91cd-9691e7cf457b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:39.565602 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e4155faa-ac94-4606-91cd-9691e7cf457b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:39.566041 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e4155faa-ac94-4606-91cd-9691e7cf457b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:39.724743 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e4155faa-ac94-4606-91cd-9691e7cf457b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:39.733017 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e4155faa-ac94-4606-91cd-9691e7cf457b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:39.734515 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e4155faa-ac94-4606-91cd-9691e7cf457b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:39.735678 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-e4155faa-ac94-4606-91cd-9691e7cf457b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1722 microversion: 2.20 time: 0.182755 May 23 17:24:39.736252 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 377/743] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:24:39 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:24:40.512642 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-04da5cf8-b2ec-4e03-8b11-e957e7bc0b58 req-a99e3352-35b8-412b-b85b-43710f126748 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "549b0d88-0258-406c-90f1-fe4af4916e98", "name": "network-vif-deleted", "tag": "d71c640f-947d-49b7-9fa5-19acd7e88bcb"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:24:40.521546 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-04da5cf8-b2ec-4e03-8b11-e957e7bc0b58 req-a99e3352-35b8-412b-b85b-43710f126748 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:40.521995 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-04da5cf8-b2ec-4e03-8b11-e957e7bc0b58 req-a99e3352-35b8-412b-b85b-43710f126748 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:40.534267 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-04da5cf8-b2ec-4e03-8b11-e957e7bc0b58 req-a99e3352-35b8-412b-b85b-43710f126748 service nova] Creating event network-vif-deleted:d71c640f-947d-49b7-9fa5-19acd7e88bcb for instance 549b0d88-0258-406c-90f1-fe4af4916e98 on hv-cinder-84299 May 23 17:24:40.539541 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-04da5cf8-b2ec-4e03-8b11-e957e7bc0b58 req-a99e3352-35b8-412b-b85b-43710f126748 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031386 May 23 17:24:40.543485 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 367/744] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:24:40.568655 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-86f8ff59-8cfc-43aa-90a5-859cf03bf8c6 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:40.570763 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-86f8ff59-8cfc-43aa-90a5-859cf03bf8c6 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:40.580124 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-86f8ff59-8cfc-43aa-90a5-859cf03bf8c6 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:40.580579 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-86f8ff59-8cfc-43aa-90a5-859cf03bf8c6 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:40.581386 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-86f8ff59-8cfc-43aa-90a5-859cf03bf8c6 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:40.581906 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-86f8ff59-8cfc-43aa-90a5-859cf03bf8c6 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:40.738087 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-86f8ff59-8cfc-43aa-90a5-859cf03bf8c6 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:40.747588 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-86f8ff59-8cfc-43aa-90a5-859cf03bf8c6 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1724 microversion: 2.1 time: 0.183364 May 23 17:24:40.748187 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 378/745] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:24:40 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:24:40.755882 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b5719ec4-4e1f-4e7c-81a0-615e1a20354c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:40.756585 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b5719ec4-4e1f-4e7c-81a0-615e1a20354c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:40.766325 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b5719ec4-4e1f-4e7c-81a0-615e1a20354c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:40.767050 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b5719ec4-4e1f-4e7c-81a0-615e1a20354c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:40.769484 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b5719ec4-4e1f-4e7c-81a0-615e1a20354c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:40.770263 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b5719ec4-4e1f-4e7c-81a0-615e1a20354c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:40.813922 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b5719ec4-4e1f-4e7c-81a0-615e1a20354c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:40.814726 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b5719ec4-4e1f-4e7c-81a0-615e1a20354c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:40.815384 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.objects.instance [None req-b5719ec4-4e1f-4e7c-81a0-615e1a20354c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lazy-loading 'fault' on Instance uuid 549b0d88-0258-406c-90f1-fe4af4916e98 {{(pid=117909) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 17:24:40.865622 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b5719ec4-4e1f-4e7c-81a0-615e1a20354c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:40.874993 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b5719ec4-4e1f-4e7c-81a0-615e1a20354c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:40.876644 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b5719ec4-4e1f-4e7c-81a0-615e1a20354c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8485b40daa3347d3a438c2006d9d4ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5724b98399214909a99dec90c2718c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:40.877946 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b5719ec4-4e1f-4e7c-81a0-615e1a20354c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 200 len: 1370 microversion: 2.20 time: 0.126287 May 23 17:24:40.878598 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 368/746] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:24:40 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 1370 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 17:24:41.769467 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-6c028afd-11b6-4567-bf4e-0bcc739a4127 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:41.770690 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-6c028afd-11b6-4567-bf4e-0bcc739a4127 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:41.779087 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6c028afd-11b6-4567-bf4e-0bcc739a4127 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:41.779545 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6c028afd-11b6-4567-bf4e-0bcc739a4127 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:41.780338 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6c028afd-11b6-4567-bf4e-0bcc739a4127 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:41.780804 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6c028afd-11b6-4567-bf4e-0bcc739a4127 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:41.896932 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-dcea6097-2140-4da6-ac2c-508fd9a3fa9f tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:41.897509 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-dcea6097-2140-4da6-ac2c-508fd9a3fa9f tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:41.904144 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dcea6097-2140-4da6-ac2c-508fd9a3fa9f tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:41.904637 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dcea6097-2140-4da6-ac2c-508fd9a3fa9f tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:41.905391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dcea6097-2140-4da6-ac2c-508fd9a3fa9f tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:41.905820 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dcea6097-2140-4da6-ac2c-508fd9a3fa9f tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:41.922458 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-dcea6097-2140-4da6-ac2c-508fd9a3fa9f tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] HTTP exception thrown: Instance 549b0d88-0258-406c-90f1-fe4af4916e98 could not be found. May 23 17:24:41.922625 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-6c028afd-11b6-4567-bf4e-0bcc739a4127 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:41.924105 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-dcea6097-2140-4da6-ac2c-508fd9a3fa9f tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Request method failure captured: May 23 17:24:41.924105 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: request: GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 HTTP/1.1 May 23 17:24:41.924105 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept: application/json May 23 17:24:41.924105 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity May 23 17:24:41.924105 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Connection: close May 23 17:24:41.924105 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Length: 0 May 23 17:24:41.924105 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Type: application/json May 23 17:24:41.924105 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Host: 10.222.0.46 May 23 17:24:41.924105 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None May 23 17:24:41.924105 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.9 May 23 17:24:41.924105 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABii8HA4AQZ8G3CbvjytFl_DCO_PsWDefbQHejYwJxf1bVsGWOZ4Emw88Glui5WzBUo3xGWTz7X02Cy3SBypDOKQywIxe-V1BcYK4IdaEluMfkLRjOFDuM_gPcfQoI18RMf4eC01wyP9LAS1CRm3vSVn1VQ-z6r1Yh5zrkw80OHdulI4YA May 23 17:24:41.924105 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Id: None May 23 17:24:41.924105 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Name: None May 23 17:24:41.924105 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed May 23 17:24:41.924105 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True May 23 17:24:41.924105 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Openstack-Nova-Api-Version: 2.20 May 23 17:24:41.924105 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default May 23 17:24:41.924105 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default May 23 17:24:41.924105 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Id: 5724b98399214909a99dec90c2718c44 May 23 17:24:41.924105 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1616966163 May 23 17:24:41.924105 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Role: reader,member May 23 17:24:41.924105 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Roles: reader,member May 23 17:24:41.925752 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5724b98399214909a99dec90c2718c44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5724b98399214909a99dec90c2718c44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5724b98399214909a99dec90c2718c44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5724b98399214909a99dec90c2718c44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:24:41.925752 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1616966163 May 23 17:24:41.925752 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 5724b98399214909a99dec90c2718c44 May 23 17:24:41.925752 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1616966163 May 23 17:24:41.925752 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User: tempest-AttachVolumeShelveTestJSON-1616966163-project May 23 17:24:41.925752 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default May 23 17:24:41.925752 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default May 23 17:24:41.925752 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Id: 8485b40daa3347d3a438c2006d9d4ef5 May 23 17:24:41.925752 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1616966163-project May 23 17:24:41.925752 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: method: > May 23 17:24:41.925752 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: exception: Instance 549b0d88-0258-406c-90f1-fe4af4916e98 could not be found. May 23 17:24:41.925752 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: action_args: {'id': '549b0d88-0258-406c-90f1-fe4af4916e98'} May 23 17:24:41.926661 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:24:41.926661 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:24:41.926661 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:24:41.926661 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:24:41.926661 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:24:41.926661 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:24:41.926661 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:24:41.926661 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:24:41.926661 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:24:41.926661 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:24:41.926661 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 549b0d88-0258-406c-90f1-fe4af4916e98 could not be found. May 23 17:24:41.926661 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:24:41.926661 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:24:41.926661 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:24:41.926661 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:24:41.926661 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:24:41.926661 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:24:41.926661 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:24:41.926661 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:24:41.926661 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:24:41.928141 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:24:41.928141 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 17:24:41.928141 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 17:24:41.928141 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:24:41.928141 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:24:41.928141 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:24:41.928141 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:24:41.928141 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 549b0d88-0258-406c-90f1-fe4af4916e98 could not be found. May 23 17:24:41.928141 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:24:41.928141 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:24:41.928141 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:24:41.928141 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:24:41.928141 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:24:41.928141 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:24:41.928141 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:24:41.928141 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:24:41.928141 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 549b0d88-0258-406c-90f1-fe4af4916e98 could not be found. May 23 17:24:41.928141 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:24:41.929615 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-dcea6097-2140-4da6-ac2c-508fd9a3fa9f tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Returning 404 to user: Instance 549b0d88-0258-406c-90f1-fe4af4916e98 could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:24:41.929615 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-dcea6097-2140-4da6-ac2c-508fd9a3fa9f tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 404 len: 111 microversion: 2.20 time: 0.032647 May 23 17:24:41.929937 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 369/747] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:24:41 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 17:24:41.930625 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-6c028afd-11b6-4567-bf4e-0bcc739a4127 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1724 microversion: 2.1 time: 0.167726 May 23 17:24:41.931227 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 379/748] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:24:41 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:24:41.934736 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6dc4b772-c045-437d-affe-660528b1eeab tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '.version_select at 0x7fd793c4faf0>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:41.954502 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6dc4b772-c045-437d-affe-660528b1eeab tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-401533959" status: 204 len: 0 microversion: 2.20 time: 0.023515 May 23 17:24:41.955068 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 370/749] 10.222.0.46 () {60 vars in 1258 bytes} [Mon May 23 17:24:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-401533959 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 23 17:24:42.951482 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-26036657-6e80-49f6-b041-4118b95a35b7 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:42.952322 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-26036657-6e80-49f6-b041-4118b95a35b7 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:42.961984 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-26036657-6e80-49f6-b041-4118b95a35b7 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:42.964957 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-26036657-6e80-49f6-b041-4118b95a35b7 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:42.964957 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-26036657-6e80-49f6-b041-4118b95a35b7 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:42.964957 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-26036657-6e80-49f6-b041-4118b95a35b7 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:43.100488 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-26036657-6e80-49f6-b041-4118b95a35b7 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:43.109317 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-26036657-6e80-49f6-b041-4118b95a35b7 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1724 microversion: 2.1 time: 0.163402 May 23 17:24:43.109894 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 380/750] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:24:42 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:24:43.715605 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6150cbd9-ca67-4eab-b229-ce68b9e9230b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:43.716138 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6150cbd9-ca67-4eab-b229-ce68b9e9230b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:43.726119 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6150cbd9-ca67-4eab-b229-ce68b9e9230b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:43.726756 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6150cbd9-ca67-4eab-b229-ce68b9e9230b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:43.728144 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6150cbd9-ca67-4eab-b229-ce68b9e9230b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:43.728631 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6150cbd9-ca67-4eab-b229-ce68b9e9230b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:43.741886 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-6150cbd9-ca67-4eab-b229-ce68b9e9230b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] HTTP exception thrown: Instance 549b0d88-0258-406c-90f1-fe4af4916e98 could not be found. May 23 17:24:43.743575 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6150cbd9-ca67-4eab-b229-ce68b9e9230b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Request method failure captured: May 23 17:24:43.743575 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: request: DELETE /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 HTTP/1.1 May 23 17:24:43.743575 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept: application/json May 23 17:24:43.743575 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity May 23 17:24:43.743575 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Connection: close May 23 17:24:43.743575 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Length: 0 May 23 17:24:43.743575 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Type: application/json May 23 17:24:43.743575 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Host: 10.222.0.46 May 23 17:24:43.743575 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None May 23 17:24:43.743575 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.9 May 23 17:24:43.743575 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABii8HA4AQZ8G3CbvjytFl_DCO_PsWDefbQHejYwJxf1bVsGWOZ4Emw88Glui5WzBUo3xGWTz7X02Cy3SBypDOKQywIxe-V1BcYK4IdaEluMfkLRjOFDuM_gPcfQoI18RMf4eC01wyP9LAS1CRm3vSVn1VQ-z6r1Yh5zrkw80OHdulI4YA May 23 17:24:43.743575 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Id: None May 23 17:24:43.743575 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Name: None May 23 17:24:43.743575 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed May 23 17:24:43.743575 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True May 23 17:24:43.743575 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Openstack-Nova-Api-Version: 2.20 May 23 17:24:43.743575 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default May 23 17:24:43.743575 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default May 23 17:24:43.743575 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Id: 5724b98399214909a99dec90c2718c44 May 23 17:24:43.743575 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1616966163 May 23 17:24:43.743575 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Role: reader,member May 23 17:24:43.743575 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Roles: reader,member May 23 17:24:43.745245 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5724b98399214909a99dec90c2718c44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5724b98399214909a99dec90c2718c44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5724b98399214909a99dec90c2718c44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5724b98399214909a99dec90c2718c44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:24:43.745245 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1616966163 May 23 17:24:43.745245 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 5724b98399214909a99dec90c2718c44 May 23 17:24:43.745245 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1616966163 May 23 17:24:43.745245 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User: tempest-AttachVolumeShelveTestJSON-1616966163-project May 23 17:24:43.745245 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default May 23 17:24:43.745245 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default May 23 17:24:43.745245 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Id: 8485b40daa3347d3a438c2006d9d4ef5 May 23 17:24:43.745245 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1616966163-project May 23 17:24:43.745245 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: method: > May 23 17:24:43.745245 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: exception: Instance 549b0d88-0258-406c-90f1-fe4af4916e98 could not be found. May 23 17:24:43.745245 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: action_args: {'id': '549b0d88-0258-406c-90f1-fe4af4916e98'} May 23 17:24:43.746035 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:24:43.746035 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:24:43.746035 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:24:43.746035 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:24:43.746035 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:24:43.746035 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:24:43.746035 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:24:43.746035 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:24:43.746035 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:24:43.746035 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:24:43.746035 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 549b0d88-0258-406c-90f1-fe4af4916e98 could not be found. May 23 17:24:43.746035 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:24:43.746035 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:24:43.746035 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:24:43.746035 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:24:43.746035 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:24:43.746035 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:24:43.746035 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:24:43.746035 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:24:43.746035 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:24:43.747193 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:24:43.747193 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 17:24:43.747193 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 17:24:43.747193 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 17:24:43.747193 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 17:24:43.747193 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:24:43.747193 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:24:43.747193 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:24:43.747193 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:24:43.747193 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 549b0d88-0258-406c-90f1-fe4af4916e98 could not be found. May 23 17:24:43.747193 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:24:43.747193 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:24:43.747193 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:24:43.747193 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:24:43.747193 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:24:43.747193 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:24:43.747193 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:24:43.747193 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:24:43.747193 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 549b0d88-0258-406c-90f1-fe4af4916e98 could not be found. May 23 17:24:43.747193 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:24:43.748576 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6150cbd9-ca67-4eab-b229-ce68b9e9230b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Returning 404 to user: Instance 549b0d88-0258-406c-90f1-fe4af4916e98 could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:24:43.748576 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6150cbd9-ca67-4eab-b229-ce68b9e9230b tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "DELETE /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 404 len: 111 microversion: 2.20 time: 0.036573 May 23 17:24:43.748576 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 371/751] 10.222.0.46 () {60 vars in 1279 bytes} [Mon May 23 17:24:43 2022] DELETE /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 23 17:24:43.753636 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-15dce61a-ccbc-4acb-b6dd-16a29e630a09 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:43.754262 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-15dce61a-ccbc-4acb-b6dd-16a29e630a09 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: 549b0d88-0258-406c-90f1-fe4af4916e98] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:43.760921 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-15dce61a-ccbc-4acb-b6dd-16a29e630a09 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:43.761372 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-15dce61a-ccbc-4acb-b6dd-16a29e630a09 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:43.762472 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-15dce61a-ccbc-4acb-b6dd-16a29e630a09 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:43.762903 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-15dce61a-ccbc-4acb-b6dd-16a29e630a09 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:43.776172 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-15dce61a-ccbc-4acb-b6dd-16a29e630a09 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] HTTP exception thrown: Instance 549b0d88-0258-406c-90f1-fe4af4916e98 could not be found. May 23 17:24:43.777836 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-15dce61a-ccbc-4acb-b6dd-16a29e630a09 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Request method failure captured: May 23 17:24:43.777836 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: request: GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 HTTP/1.1 May 23 17:24:43.777836 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept: application/json May 23 17:24:43.777836 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity May 23 17:24:43.777836 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Connection: close May 23 17:24:43.777836 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Length: 0 May 23 17:24:43.777836 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Type: application/json May 23 17:24:43.777836 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Host: 10.222.0.46 May 23 17:24:43.777836 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None May 23 17:24:43.777836 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.9 May 23 17:24:43.777836 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABii8HA4AQZ8G3CbvjytFl_DCO_PsWDefbQHejYwJxf1bVsGWOZ4Emw88Glui5WzBUo3xGWTz7X02Cy3SBypDOKQywIxe-V1BcYK4IdaEluMfkLRjOFDuM_gPcfQoI18RMf4eC01wyP9LAS1CRm3vSVn1VQ-z6r1Yh5zrkw80OHdulI4YA May 23 17:24:43.777836 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Id: None May 23 17:24:43.777836 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Name: None May 23 17:24:43.777836 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed May 23 17:24:43.777836 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True May 23 17:24:43.777836 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Openstack-Nova-Api-Version: 2.20 May 23 17:24:43.777836 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default May 23 17:24:43.777836 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default May 23 17:24:43.777836 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Id: 5724b98399214909a99dec90c2718c44 May 23 17:24:43.777836 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1616966163 May 23 17:24:43.777836 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Role: reader,member May 23 17:24:43.777836 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Roles: reader,member May 23 17:24:43.779505 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5724b98399214909a99dec90c2718c44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5724b98399214909a99dec90c2718c44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5724b98399214909a99dec90c2718c44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5724b98399214909a99dec90c2718c44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:24:43.779505 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1616966163 May 23 17:24:43.779505 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 5724b98399214909a99dec90c2718c44 May 23 17:24:43.779505 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1616966163 May 23 17:24:43.779505 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User: tempest-AttachVolumeShelveTestJSON-1616966163-project May 23 17:24:43.779505 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default May 23 17:24:43.779505 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default May 23 17:24:43.779505 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Id: 8485b40daa3347d3a438c2006d9d4ef5 May 23 17:24:43.779505 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1616966163-project May 23 17:24:43.779505 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: method: > May 23 17:24:43.779505 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: exception: Instance 549b0d88-0258-406c-90f1-fe4af4916e98 could not be found. May 23 17:24:43.779505 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: action_args: {'id': '549b0d88-0258-406c-90f1-fe4af4916e98'} May 23 17:24:43.780511 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:24:43.780511 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:24:43.780511 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:24:43.780511 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:24:43.780511 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:24:43.780511 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:24:43.780511 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:24:43.780511 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:24:43.780511 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:24:43.780511 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:24:43.780511 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 549b0d88-0258-406c-90f1-fe4af4916e98 could not be found. May 23 17:24:43.780511 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:24:43.780511 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:24:43.780511 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:24:43.780511 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:24:43.780511 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:24:43.780511 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:24:43.780511 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:24:43.780511 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:24:43.780511 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:24:43.781952 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:24:43.781952 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 17:24:43.781952 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 17:24:43.781952 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:24:43.781952 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:24:43.781952 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:24:43.781952 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:24:43.781952 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 549b0d88-0258-406c-90f1-fe4af4916e98 could not be found. May 23 17:24:43.781952 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:24:43.781952 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:24:43.781952 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:24:43.781952 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:24:43.781952 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:24:43.781952 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:24:43.781952 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:24:43.781952 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:24:43.781952 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 549b0d88-0258-406c-90f1-fe4af4916e98 could not be found. May 23 17:24:43.781952 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:24:43.783324 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-15dce61a-ccbc-4acb-b6dd-16a29e630a09 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Returning 404 to user: Instance 549b0d88-0258-406c-90f1-fe4af4916e98 could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:24:43.783324 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-15dce61a-ccbc-4acb-b6dd-16a29e630a09 tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98" status: 404 len: 111 microversion: 2.20 time: 0.029520 May 23 17:24:43.783324 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 381/752] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:24:43 2022] GET /compute/v2.1/servers/549b0d88-0258-406c-90f1-fe4af4916e98 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 17:24:44.130591 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8c2ce4c8-c55d-4c70-9be4-cfdd473c7ba2 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:44.131602 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8c2ce4c8-c55d-4c70-9be4-cfdd473c7ba2 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:44.142584 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8c2ce4c8-c55d-4c70-9be4-cfdd473c7ba2 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:44.143297 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8c2ce4c8-c55d-4c70-9be4-cfdd473c7ba2 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:44.144652 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8c2ce4c8-c55d-4c70-9be4-cfdd473c7ba2 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:44.145448 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8c2ce4c8-c55d-4c70-9be4-cfdd473c7ba2 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:44.276719 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8c2ce4c8-c55d-4c70-9be4-cfdd473c7ba2 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:44.285119 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8c2ce4c8-c55d-4c70-9be4-cfdd473c7ba2 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1724 microversion: 2.1 time: 0.160998 May 23 17:24:44.285693 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 372/753] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:24:44 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:24:44.924206 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d0855d97-5747-4d12-b738-b5f71236ed5f tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:44.924808 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d0855d97-5747-4d12-b738-b5f71236ed5f tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:44.932374 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d0855d97-5747-4d12-b738-b5f71236ed5f tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:44.932871 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d0855d97-5747-4d12-b738-b5f71236ed5f tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:44.933653 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d0855d97-5747-4d12-b738-b5f71236ed5f tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:44.934096 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d0855d97-5747-4d12-b738-b5f71236ed5f tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:44.947662 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-d0855d97-5747-4d12-b738-b5f71236ed5f tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] HTTP exception thrown: Instance f4273c3a-0aba-4184-b088-2feaea1b1091 could not be found. May 23 17:24:44.949278 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d0855d97-5747-4d12-b738-b5f71236ed5f tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Request method failure captured: May 23 17:24:44.949278 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: request: DELETE /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 HTTP/1.1 May 23 17:24:44.949278 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept: application/json May 23 17:24:44.949278 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity May 23 17:24:44.949278 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Connection: close May 23 17:24:44.949278 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Length: 0 May 23 17:24:44.949278 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Type: application/json May 23 17:24:44.949278 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Host: 10.222.0.46 May 23 17:24:44.949278 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None May 23 17:24:44.949278 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.9 May 23 17:24:44.949278 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABii8HA4AQZ8G3CbvjytFl_DCO_PsWDefbQHejYwJxf1bVsGWOZ4Emw88Glui5WzBUo3xGWTz7X02Cy3SBypDOKQywIxe-V1BcYK4IdaEluMfkLRjOFDuM_gPcfQoI18RMf4eC01wyP9LAS1CRm3vSVn1VQ-z6r1Yh5zrkw80OHdulI4YA May 23 17:24:44.949278 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Id: None May 23 17:24:44.949278 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Name: None May 23 17:24:44.949278 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed May 23 17:24:44.949278 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True May 23 17:24:44.949278 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Openstack-Nova-Api-Version: 2.20 May 23 17:24:44.949278 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default May 23 17:24:44.949278 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default May 23 17:24:44.949278 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Id: 5724b98399214909a99dec90c2718c44 May 23 17:24:44.949278 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1616966163 May 23 17:24:44.949278 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Role: reader,member May 23 17:24:44.949278 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Roles: reader,member May 23 17:24:44.950793 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5724b98399214909a99dec90c2718c44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5724b98399214909a99dec90c2718c44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5724b98399214909a99dec90c2718c44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5724b98399214909a99dec90c2718c44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:24:44.950793 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1616966163 May 23 17:24:44.950793 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 5724b98399214909a99dec90c2718c44 May 23 17:24:44.950793 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1616966163 May 23 17:24:44.950793 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User: tempest-AttachVolumeShelveTestJSON-1616966163-project May 23 17:24:44.950793 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default May 23 17:24:44.950793 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default May 23 17:24:44.950793 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Id: 8485b40daa3347d3a438c2006d9d4ef5 May 23 17:24:44.950793 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1616966163-project May 23 17:24:44.950793 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: method: > May 23 17:24:44.950793 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: exception: Instance f4273c3a-0aba-4184-b088-2feaea1b1091 could not be found. May 23 17:24:44.950793 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: action_args: {'id': 'f4273c3a-0aba-4184-b088-2feaea1b1091'} May 23 17:24:44.951730 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:24:44.951730 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:24:44.951730 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:24:44.951730 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:24:44.951730 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:24:44.951730 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:24:44.951730 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:24:44.951730 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:24:44.951730 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:24:44.951730 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:24:44.951730 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4273c3a-0aba-4184-b088-2feaea1b1091 could not be found. May 23 17:24:44.951730 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:24:44.951730 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:24:44.951730 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:24:44.951730 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:24:44.951730 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:24:44.951730 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:24:44.951730 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:24:44.951730 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:24:44.951730 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:24:44.953293 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:24:44.953293 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 17:24:44.953293 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 17:24:44.953293 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 17:24:44.953293 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 17:24:44.953293 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:24:44.953293 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:24:44.953293 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:24:44.953293 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:24:44.953293 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4273c3a-0aba-4184-b088-2feaea1b1091 could not be found. May 23 17:24:44.953293 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:24:44.953293 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:24:44.953293 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:24:44.953293 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:24:44.953293 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:24:44.953293 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:24:44.953293 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:24:44.953293 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:24:44.953293 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4273c3a-0aba-4184-b088-2feaea1b1091 could not be found. May 23 17:24:44.953293 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:24:44.955078 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d0855d97-5747-4d12-b738-b5f71236ed5f tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Returning 404 to user: Instance f4273c3a-0aba-4184-b088-2feaea1b1091 could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:24:44.955078 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d0855d97-5747-4d12-b738-b5f71236ed5f tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 404 len: 111 microversion: 2.20 time: 0.030944 May 23 17:24:44.955078 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 382/754] 10.222.0.46 () {60 vars in 1279 bytes} [Mon May 23 17:24:44 2022] DELETE /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 17:24:44.959163 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-954ef2ee-d0d5-41e0-a742-fcc8e0c3ae3c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:44.959802 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-954ef2ee-d0d5-41e0-a742-fcc8e0c3ae3c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] [instance: f4273c3a-0aba-4184-b088-2feaea1b1091] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:44.966778 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-954ef2ee-d0d5-41e0-a742-fcc8e0c3ae3c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:44.967227 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-954ef2ee-d0d5-41e0-a742-fcc8e0c3ae3c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:44.967998 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-954ef2ee-d0d5-41e0-a742-fcc8e0c3ae3c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:44.968436 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-954ef2ee-d0d5-41e0-a742-fcc8e0c3ae3c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:44.981932 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-954ef2ee-d0d5-41e0-a742-fcc8e0c3ae3c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] HTTP exception thrown: Instance f4273c3a-0aba-4184-b088-2feaea1b1091 could not be found. May 23 17:24:44.986027 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-954ef2ee-d0d5-41e0-a742-fcc8e0c3ae3c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Request method failure captured: May 23 17:24:44.986027 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: request: GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 HTTP/1.1 May 23 17:24:44.986027 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept: application/json May 23 17:24:44.986027 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity May 23 17:24:44.986027 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Connection: close May 23 17:24:44.986027 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Length: 0 May 23 17:24:44.986027 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Type: application/json May 23 17:24:44.986027 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Host: 10.222.0.46 May 23 17:24:44.986027 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None May 23 17:24:44.986027 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.9 May 23 17:24:44.986027 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABii8HA4AQZ8G3CbvjytFl_DCO_PsWDefbQHejYwJxf1bVsGWOZ4Emw88Glui5WzBUo3xGWTz7X02Cy3SBypDOKQywIxe-V1BcYK4IdaEluMfkLRjOFDuM_gPcfQoI18RMf4eC01wyP9LAS1CRm3vSVn1VQ-z6r1Yh5zrkw80OHdulI4YA May 23 17:24:44.986027 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Id: None May 23 17:24:44.986027 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Name: None May 23 17:24:44.986027 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed May 23 17:24:44.986027 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True May 23 17:24:44.986027 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Openstack-Nova-Api-Version: 2.20 May 23 17:24:44.986027 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default May 23 17:24:44.986027 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default May 23 17:24:44.986027 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Id: 5724b98399214909a99dec90c2718c44 May 23 17:24:44.986027 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1616966163 May 23 17:24:44.986027 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Role: reader,member May 23 17:24:44.986027 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Roles: reader,member May 23 17:24:44.987550 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5724b98399214909a99dec90c2718c44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5724b98399214909a99dec90c2718c44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5724b98399214909a99dec90c2718c44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5724b98399214909a99dec90c2718c44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:24:44.987550 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1616966163 May 23 17:24:44.987550 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 5724b98399214909a99dec90c2718c44 May 23 17:24:44.987550 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1616966163 May 23 17:24:44.987550 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User: tempest-AttachVolumeShelveTestJSON-1616966163-project May 23 17:24:44.987550 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default May 23 17:24:44.987550 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default May 23 17:24:44.987550 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Id: 8485b40daa3347d3a438c2006d9d4ef5 May 23 17:24:44.987550 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1616966163-project May 23 17:24:44.987550 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: method: > May 23 17:24:44.987550 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: exception: Instance f4273c3a-0aba-4184-b088-2feaea1b1091 could not be found. May 23 17:24:44.987550 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: action_args: {'id': 'f4273c3a-0aba-4184-b088-2feaea1b1091'} May 23 17:24:44.988327 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:24:44.988327 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:24:44.988327 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:24:44.988327 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:24:44.988327 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:24:44.988327 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:24:44.988327 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:24:44.988327 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:24:44.988327 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:24:44.988327 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:24:44.988327 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4273c3a-0aba-4184-b088-2feaea1b1091 could not be found. May 23 17:24:44.988327 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:24:44.988327 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:24:44.988327 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:24:44.988327 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:24:44.988327 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:24:44.988327 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:24:44.988327 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:24:44.988327 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:24:44.988327 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:24:44.989517 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:24:44.989517 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 17:24:44.989517 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 17:24:44.989517 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:24:44.989517 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:24:44.989517 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:24:44.989517 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:24:44.989517 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4273c3a-0aba-4184-b088-2feaea1b1091 could not be found. May 23 17:24:44.989517 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:24:44.989517 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:24:44.989517 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:24:44.989517 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:24:44.989517 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:24:44.989517 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:24:44.989517 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:24:44.989517 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:24:44.989517 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4273c3a-0aba-4184-b088-2feaea1b1091 could not be found. May 23 17:24:44.989517 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:24:44.990580 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-954ef2ee-d0d5-41e0-a742-fcc8e0c3ae3c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] Returning 404 to user: Instance f4273c3a-0aba-4184-b088-2feaea1b1091 could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:24:44.990580 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-954ef2ee-d0d5-41e0-a742-fcc8e0c3ae3c tempest-AttachVolumeShelveTestJSON-1616966163 tempest-AttachVolumeShelveTestJSON-1616966163-project] 10.222.0.46 "GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091" status: 404 len: 111 microversion: 2.20 time: 0.032152 May 23 17:24:44.990580 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 373/755] 10.222.0.46 () {60 vars in 1276 bytes} [Mon May 23 17:24:44 2022] GET /compute/v2.1/servers/f4273c3a-0aba-4184-b088-2feaea1b1091 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 17:24:45.303091 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-fe5b733b-27cf-4d14-a844-e7970100dded tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:45.303709 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-fe5b733b-27cf-4d14-a844-e7970100dded tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:45.310721 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fe5b733b-27cf-4d14-a844-e7970100dded tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:45.311168 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fe5b733b-27cf-4d14-a844-e7970100dded tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:45.311959 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fe5b733b-27cf-4d14-a844-e7970100dded tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:45.312388 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fe5b733b-27cf-4d14-a844-e7970100dded tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:45.581496 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-fe5b733b-27cf-4d14-a844-e7970100dded tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:45.589924 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-fe5b733b-27cf-4d14-a844-e7970100dded tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1724 microversion: 2.1 time: 0.290789 May 23 17:24:45.590503 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 383/756] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:24:45 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1724 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:24:46.612588 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6c91bfc9-6779-4263-9c17-0b0d468feb42 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:46.613284 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6c91bfc9-6779-4263-9c17-0b0d468feb42 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:46.623000 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6c91bfc9-6779-4263-9c17-0b0d468feb42 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:46.623617 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6c91bfc9-6779-4263-9c17-0b0d468feb42 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:46.624841 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6c91bfc9-6779-4263-9c17-0b0d468feb42 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:46.625506 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6c91bfc9-6779-4263-9c17-0b0d468feb42 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:46.823005 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6c91bfc9-6779-4263-9c17-0b0d468feb42 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:46.831293 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6c91bfc9-6779-4263-9c17-0b0d468feb42 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1724 microversion: 2.1 time: 0.222766 May 23 17:24:46.832029 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 374/757] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:24:46 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:24:47.848432 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d3b60542-bd39-4e6d-a111-7285b5521c79 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:47.849786 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d3b60542-bd39-4e6d-a111-7285b5521c79 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:47.856830 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d3b60542-bd39-4e6d-a111-7285b5521c79 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:47.857539 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d3b60542-bd39-4e6d-a111-7285b5521c79 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:47.858326 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d3b60542-bd39-4e6d-a111-7285b5521c79 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:47.858768 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d3b60542-bd39-4e6d-a111-7285b5521c79 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:47.991120 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d3b60542-bd39-4e6d-a111-7285b5521c79 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:47.999432 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d3b60542-bd39-4e6d-a111-7285b5521c79 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1724 microversion: 2.1 time: 0.154943 May 23 17:24:48.000003 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 384/758] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:24:47 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:24:49.017203 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0d02e2c8-60c1-48b4-af52-5cf630e4ac7b tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:49.017737 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0d02e2c8-60c1-48b4-af52-5cf630e4ac7b tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:49.023996 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0d02e2c8-60c1-48b4-af52-5cf630e4ac7b tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:49.024451 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0d02e2c8-60c1-48b4-af52-5cf630e4ac7b tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:49.025283 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0d02e2c8-60c1-48b4-af52-5cf630e4ac7b tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:49.025720 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0d02e2c8-60c1-48b4-af52-5cf630e4ac7b tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:49.155030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0d02e2c8-60c1-48b4-af52-5cf630e4ac7b tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:49.163118 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0d02e2c8-60c1-48b4-af52-5cf630e4ac7b tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1724 microversion: 2.1 time: 0.149817 May 23 17:24:49.163804 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 375/759] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:24:49 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:24:50.180121 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-43655fec-5f6c-420e-8c7f-f63c66b82750 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:50.181570 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-43655fec-5f6c-420e-8c7f-f63c66b82750 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:50.196919 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-43655fec-5f6c-420e-8c7f-f63c66b82750 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:50.197578 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-43655fec-5f6c-420e-8c7f-f63c66b82750 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:50.198552 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-43655fec-5f6c-420e-8c7f-f63c66b82750 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:50.199149 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-43655fec-5f6c-420e-8c7f-f63c66b82750 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:50.432783 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-43655fec-5f6c-420e-8c7f-f63c66b82750 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:50.452944 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-43655fec-5f6c-420e-8c7f-f63c66b82750 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1724 microversion: 2.1 time: 0.276410 May 23 17:24:50.463620 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 385/760] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:24:50 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1724 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:24:51.473054 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d55b4f53-3486-45f5-8c96-a5b822a20943 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:51.473670 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d55b4f53-3486-45f5-8c96-a5b822a20943 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:51.481786 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d55b4f53-3486-45f5-8c96-a5b822a20943 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:51.482649 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d55b4f53-3486-45f5-8c96-a5b822a20943 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:51.483428 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d55b4f53-3486-45f5-8c96-a5b822a20943 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:51.483865 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d55b4f53-3486-45f5-8c96-a5b822a20943 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:51.610662 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d55b4f53-3486-45f5-8c96-a5b822a20943 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:51.619313 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d55b4f53-3486-45f5-8c96-a5b822a20943 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1724 microversion: 2.1 time: 0.152520 May 23 17:24:51.619988 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 376/761] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:24:51 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:24:52.637202 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d5d628dc-9e80-4bd4-95ee-8ae378b32f24 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:52.639907 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d5d628dc-9e80-4bd4-95ee-8ae378b32f24 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:52.648183 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d5d628dc-9e80-4bd4-95ee-8ae378b32f24 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:52.648667 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d5d628dc-9e80-4bd4-95ee-8ae378b32f24 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:52.649443 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d5d628dc-9e80-4bd4-95ee-8ae378b32f24 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:52.649907 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d5d628dc-9e80-4bd4-95ee-8ae378b32f24 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:52.819447 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d5d628dc-9e80-4bd4-95ee-8ae378b32f24 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:52.823265 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:24:52.829428 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d5d628dc-9e80-4bd4-95ee-8ae378b32f24 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1724 microversion: 2.1 time: 0.196552 May 23 17:24:52.830590 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 386/762] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:24:52 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:24:53.846730 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-38ae68f2-9e41-4f0a-a5b0-bb09c0418a56 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:53.847685 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-38ae68f2-9e41-4f0a-a5b0-bb09c0418a56 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:53.879899 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-38ae68f2-9e41-4f0a-a5b0-bb09c0418a56 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:53.880840 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-38ae68f2-9e41-4f0a-a5b0-bb09c0418a56 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:53.881867 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-38ae68f2-9e41-4f0a-a5b0-bb09c0418a56 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:53.882314 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-38ae68f2-9e41-4f0a-a5b0-bb09c0418a56 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:54.052268 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-38ae68f2-9e41-4f0a-a5b0-bb09c0418a56 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:54.061725 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-38ae68f2-9e41-4f0a-a5b0-bb09c0418a56 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1724 microversion: 2.1 time: 0.219143 May 23 17:24:54.073244 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 377/763] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:24:53 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:24:54.200802 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-0283b7ba-59ee-4156-936e-48f3920aaee3 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Action: 'create', calling method: .version_select at 0x7fd7a053e550>, body: {"keypair": {"name": "tempest-keypair-180259544", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI08/foZ/yx7sC3NoWr9xODWlZb9XcgV3kE2/skLqfVm4W+q8R47COf58FYu1BZc9JoLEf2li6EcVrFd5TiPWkx34iWqKBqPhBsVbvBzPb9NGD6vbyAj8uZwgaVbY+FXqQ=="}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:24:54.215068 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-0283b7ba-59ee-4156-936e-48f3920aaee3 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Getting quotas for project 43c5da8fa182486990154b6f22539593. Resources: {'key_pairs'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 17:24:54.219363 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-0283b7ba-59ee-4156-936e-48f3920aaee3 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Getting quotas for user b4780bb497234a249b6d23afdab14370 and project 43c5da8fa182486990154b6f22539593. Resources: {'key_pairs'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 17:24:54.242433 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-0283b7ba-59ee-4156-936e-48f3920aaee3 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.195251 May 23 17:24:54.243142 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 387/764] 10.222.0.46 () {60 vars in 1158 bytes} [Mon May 23 17:24:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 17:24:55.079291 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a82f175f-8789-4dbe-a08f-eb3da266b2ad tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:55.080508 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a82f175f-8789-4dbe-a08f-eb3da266b2ad tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:55.087866 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a82f175f-8789-4dbe-a08f-eb3da266b2ad tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:55.088663 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a82f175f-8789-4dbe-a08f-eb3da266b2ad tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:55.089859 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a82f175f-8789-4dbe-a08f-eb3da266b2ad tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:55.090852 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a82f175f-8789-4dbe-a08f-eb3da266b2ad tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:55.287865 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a82f175f-8789-4dbe-a08f-eb3da266b2ad tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:55.295993 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a82f175f-8789-4dbe-a08f-eb3da266b2ad tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1724 microversion: 2.1 time: 0.221007 May 23 17:24:55.296581 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 378/765] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:24:55 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:24:55.622711 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2f8f4bb8-e3ed-4e40-95da-f10769b3ffc1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1949990928", "imageRef": "99870172-61a4-4218-9407-6a6da3fb5c83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5796957f-d0fc-4cb4-b196-c5a4f17f1ba0"}], "security_groups": [{"name": "tempest-securitygroup--1487875889"}], "key_name": "tempest-keypair-180259544", "user_data": "}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:24:55.728429 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.network.neutron [None req-2f8f4bb8-e3ed-4e40-95da-f10769b3ffc1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] validate_networks() for [('5796957f-d0fc-4cb4-b196-c5a4f17f1ba0', None, None, None, None, None)] {{(pid=117910) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 17:24:56.134369 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-2f8f4bb8-e3ed-4e40-95da-f10769b3ffc1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Flavor limits 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 17:24:56.135287 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-2f8f4bb8-e3ed-4e40-95da-f10769b3ffc1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Image limits 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 17:24:56.136102 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-2f8f4bb8-e3ed-4e40-95da-f10769b3ffc1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Flavor pref 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 17:24:56.136993 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-2f8f4bb8-e3ed-4e40-95da-f10769b3ffc1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Image pref 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 17:24:56.137618 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-2f8f4bb8-e3ed-4e40-95da-f10769b3ffc1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 17:24:56.149708 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2f8f4bb8-e3ed-4e40-95da-f10769b3ffc1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:56.150585 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2f8f4bb8-e3ed-4e40-95da-f10769b3ffc1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:56.151724 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2f8f4bb8-e3ed-4e40-95da-f10769b3ffc1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:56.152368 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2f8f4bb8-e3ed-4e40-95da-f10769b3ffc1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:56.171012 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-2f8f4bb8-e3ed-4e40-95da-f10769b3ffc1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Getting quotas for project 43c5da8fa182486990154b6f22539593. Resources: {'cores', 'instances', 'ram'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 17:24:56.175442 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-2f8f4bb8-e3ed-4e40-95da-f10769b3ffc1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Getting quotas for user b4780bb497234a249b6d23afdab14370 and project 43c5da8fa182486990154b6f22539593. Resources: {'cores', 'instances', 'ram'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 17:24:56.189077 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2f8f4bb8-e3ed-4e40-95da-f10769b3ffc1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Going to run 1 instances... {{(pid=117910) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 17:24:56.191994 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2f8f4bb8-e3ed-4e40-95da-f10769b3ffc1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 161b8434-8d45-4f38-b174-c2c2de66ec87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99870172-61a4-4218-9407-6a6da3fb5c83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117910) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 17:24:56.240678 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2f8f4bb8-e3ed-4e40-95da-f10769b3ffc1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.622705 May 23 17:24:56.241525 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 388/766] 10.222.0.46 () {60 vars in 1146 bytes} [Mon May 23 17:24:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 17:24:56.251304 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-66d9f184-6419-4baa-83e4-0b7cb1b06ab8 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:56.252502 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-66d9f184-6419-4baa-83e4-0b7cb1b06ab8 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 161b8434-8d45-4f38-b174-c2c2de66ec87] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:56.305953 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-66d9f184-6419-4baa-83e4-0b7cb1b06ab8 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:56.313556 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-66d9f184-6419-4baa-83e4-0b7cb1b06ab8 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87" status: 200 len: 1241 microversion: 2.1 time: 0.066126 May 23 17:24:56.314460 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 379/767] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:24:56 2022] GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:24:56.314562 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b6a24963-72f5-4242-875e-29099eca1e22 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:56.315600 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-b6a24963-72f5-4242-875e-29099eca1e22 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:56.325681 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b6a24963-72f5-4242-875e-29099eca1e22 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:56.326385 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b6a24963-72f5-4242-875e-29099eca1e22 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:56.327468 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b6a24963-72f5-4242-875e-29099eca1e22 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:56.327987 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b6a24963-72f5-4242-875e-29099eca1e22 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:56.486652 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b6a24963-72f5-4242-875e-29099eca1e22 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:56.496946 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b6a24963-72f5-4242-875e-29099eca1e22 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1701 microversion: 2.1 time: 0.186571 May 23 17:24:56.508180 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 389/768] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:24:56 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1701 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:24:56.513937 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9a23e823-9107-47c5-baaa-866c5074ffde tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:24:56.520412 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9a23e823-9107-47c5-baaa-866c5074ffde tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:56.521012 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9a23e823-9107-47c5-baaa-866c5074ffde tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:56.547928 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9a23e823-9107-47c5-baaa-866c5074ffde tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Going to try to start instance {{(pid=117909) start /opt/stack/nova/nova/compute/api.py:2730}} May 23 17:24:56.595064 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9a23e823-9107-47c5-baaa-866c5074ffde tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "POST /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96/action" status: 202 len: 0 microversion: 2.1 time: 0.085303 May 23 17:24:56.595685 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 380/769] 10.222.0.46 () {60 vars in 1277 bytes} [Mon May 23 17:24:56 2022] POST /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 17:24:56.603780 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d5f82d84-f285-4a0e-b852-b3be9539b87d tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:56.604763 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d5f82d84-f285-4a0e-b852-b3be9539b87d tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:56.611432 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d5f82d84-f285-4a0e-b852-b3be9539b87d tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:56.612082 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d5f82d84-f285-4a0e-b852-b3be9539b87d tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:56.613843 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d5f82d84-f285-4a0e-b852-b3be9539b87d tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:56.614528 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d5f82d84-f285-4a0e-b852-b3be9539b87d tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:56.818034 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d5f82d84-f285-4a0e-b852-b3be9539b87d tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:56.833889 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d5f82d84-f285-4a0e-b852-b3be9539b87d tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1710 microversion: 2.1 time: 0.233989 May 23 17:24:56.846418 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 390/770] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:24:56 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1710 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:24:57.146626 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-09a9e547-c4ac-4a4b-b6ba-9fe8c2db65ae tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-141595404", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-423638123", "security_groups": [{"name": "tempest-secgroup-smoke-59473231"}], "block_device_mapping_v2": [{"uuid": "3a246380-ce3c-4382-ab69-19a7d5f4003e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "53cf278b-29c3-4094-b45f-c66c3ecb5db2"}]}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:24:57.164698 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:24:57.334762 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-3472949b-9b5f-41e2-b9df-859073fc42d1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:57.335921 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-3472949b-9b5f-41e2-b9df-859073fc42d1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 161b8434-8d45-4f38-b174-c2c2de66ec87] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:57.351715 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3472949b-9b5f-41e2-b9df-859073fc42d1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:57.352667 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3472949b-9b5f-41e2-b9df-859073fc42d1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:57.353766 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3472949b-9b5f-41e2-b9df-859073fc42d1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:57.354553 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3472949b-9b5f-41e2-b9df-859073fc42d1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:57.474273 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-3472949b-9b5f-41e2-b9df-859073fc42d1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:57.483013 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-3472949b-9b5f-41e2-b9df-859073fc42d1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87" status: 200 len: 1301 microversion: 2.1 time: 0.156197 May 23 17:24:57.488977 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 391/771] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:24:57 2022] GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87 => generated 1301 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:24:57.513999 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.network.neutron [None req-09a9e547-c4ac-4a4b-b6ba-9fe8c2db65ae tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] validate_networks() for [('53cf278b-29c3-4094-b45f-c66c3ecb5db2', None, None, None, None, None)] {{(pid=117909) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 17:24:57.854666 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-4bff79c7-fb2e-4bbd-b14e-041b95a01344 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:57.857077 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-4bff79c7-fb2e-4bbd-b14e-041b95a01344 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:57.875221 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4bff79c7-fb2e-4bbd-b14e-041b95a01344 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:57.879117 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4bff79c7-fb2e-4bbd-b14e-041b95a01344 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:57.886183 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4bff79c7-fb2e-4bbd-b14e-041b95a01344 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:57.893200 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4bff79c7-fb2e-4bbd-b14e-041b95a01344 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:58.275879 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-4bff79c7-fb2e-4bbd-b14e-041b95a01344 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:58.288978 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-4bff79c7-fb2e-4bbd-b14e-041b95a01344 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1710 microversion: 2.1 time: 0.440064 May 23 17:24:58.299943 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 392/772] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:24:57 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1710 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:24:58.476228 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-09a9e547-c4ac-4a4b-b6ba-9fe8c2db65ae tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Flavor limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 17:24:58.476688 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-09a9e547-c4ac-4a4b-b6ba-9fe8c2db65ae tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Image limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 17:24:58.477177 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-09a9e547-c4ac-4a4b-b6ba-9fe8c2db65ae tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Flavor pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 17:24:58.477661 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-09a9e547-c4ac-4a4b-b6ba-9fe8c2db65ae tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Image pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 17:24:58.478031 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-09a9e547-c4ac-4a4b-b6ba-9fe8c2db65ae tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 17:24:58.488011 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-09a9e547-c4ac-4a4b-b6ba-9fe8c2db65ae tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:58.488488 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-09a9e547-c4ac-4a4b-b6ba-9fe8c2db65ae tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:58.489338 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-09a9e547-c4ac-4a4b-b6ba-9fe8c2db65ae tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:58.489781 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-09a9e547-c4ac-4a4b-b6ba-9fe8c2db65ae tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:58.502578 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-bbcf79ed-474b-4d6c-9759-01db4efc175e tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:58.503221 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-bbcf79ed-474b-4d6c-9759-01db4efc175e tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 161b8434-8d45-4f38-b174-c2c2de66ec87] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:58.509760 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bbcf79ed-474b-4d6c-9759-01db4efc175e tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:58.510439 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bbcf79ed-474b-4d6c-9759-01db4efc175e tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:58.511919 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bbcf79ed-474b-4d6c-9759-01db4efc175e tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:58.512360 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bbcf79ed-474b-4d6c-9759-01db4efc175e tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:58.512493 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:24:58.535437 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-09a9e547-c4ac-4a4b-b6ba-9fe8c2db65ae tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Getting quotas for project df984bae4f4e4d01ac06870bee8a73bf. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 17:24:58.541174 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-09a9e547-c4ac-4a4b-b6ba-9fe8c2db65ae tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Getting quotas for user dc9c9dd337834dea821cc4ea6ecc10a6 and project df984bae4f4e4d01ac06870bee8a73bf. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 17:24:58.601612 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-09a9e547-c4ac-4a4b-b6ba-9fe8c2db65ae tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Going to run 1 instances... {{(pid=117909) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 17:24:58.603933 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-09a9e547-c4ac-4a4b-b6ba-9fe8c2db65ae tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3a246380-ce3c-4382-ab69-19a7d5f4003e',volume_size=None,volume_type=None)] {{(pid=117909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 17:24:58.659723 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-bbcf79ed-474b-4d6c-9759-01db4efc175e tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:58.669405 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-bbcf79ed-474b-4d6c-9759-01db4efc175e tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87" status: 200 len: 1367 microversion: 2.1 time: 0.170827 May 23 17:24:58.670143 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 393/773] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:24:58 2022] GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:24:58.760225 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-09a9e547-c4ac-4a4b-b6ba-9fe8c2db65ae tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.617858 May 23 17:24:58.761074 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 381/774] 10.222.0.46 () {60 vars in 1146 bytes} [Mon May 23 17:24:57 2022] POST /compute/v2.1/servers => generated 404 bytes in 1620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 23 17:24:58.771808 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-760eb108-5409-4af7-80d9-bc7770c28f42 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:58.772556 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-760eb108-5409-4af7-80d9-bc7770c28f42 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:58.848285 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-760eb108-5409-4af7-80d9-bc7770c28f42 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:58.856014 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-760eb108-5409-4af7-80d9-bc7770c28f42 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449" status: 200 len: 1093 microversion: 2.1 time: 0.088124 May 23 17:24:58.866681 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 394/775] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:24:58 2022] GET /compute/v2.1/servers/a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449 => generated 1093 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:24:59.227013 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-38556733-540d-4273-8eef-a4154ed49414 req-2849fad0-7ae9-4c3a-ade4-9f081ac125ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "161b8434-8d45-4f38-b174-c2c2de66ec87", "tag": "5c5448fe-8b65-44a3-ac1f-8c9ca3dcf82b"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:24:59.251926 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-38556733-540d-4273-8eef-a4154ed49414 req-2849fad0-7ae9-4c3a-ade4-9f081ac125ad service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:59.252816 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-38556733-540d-4273-8eef-a4154ed49414 req-2849fad0-7ae9-4c3a-ade4-9f081ac125ad service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:59.271548 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-38556733-540d-4273-8eef-a4154ed49414 req-2849fad0-7ae9-4c3a-ade4-9f081ac125ad service nova] Creating event network-changed:5c5448fe-8b65-44a3-ac1f-8c9ca3dcf82b for instance 161b8434-8d45-4f38-b174-c2c2de66ec87 on hv-cinder-84299 May 23 17:24:59.276336 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-38556733-540d-4273-8eef-a4154ed49414 req-2849fad0-7ae9-4c3a-ade4-9f081ac125ad service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056133 May 23 17:24:59.277046 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 382/776] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:24:59.306272 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-37e3eda0-5911-471c-81f3-45490c554eb9 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:59.306896 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-37e3eda0-5911-471c-81f3-45490c554eb9 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:59.310286 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:24:59.318318 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-37e3eda0-5911-471c-81f3-45490c554eb9 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:59.319121 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-37e3eda0-5911-471c-81f3-45490c554eb9 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:59.319931 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-37e3eda0-5911-471c-81f3-45490c554eb9 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:59.320381 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-37e3eda0-5911-471c-81f3-45490c554eb9 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:59.472300 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-37e3eda0-5911-471c-81f3-45490c554eb9 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:59.480580 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-37e3eda0-5911-471c-81f3-45490c554eb9 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1714 microversion: 2.1 time: 0.178253 May 23 17:24:59.481178 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 395/777] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:24:59 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1714 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:24:59.688632 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-742cea43-ce97-46b3-a621-5832abd0e312 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:59.689447 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-742cea43-ce97-46b3-a621-5832abd0e312 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 161b8434-8d45-4f38-b174-c2c2de66ec87] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:59.696855 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-742cea43-ce97-46b3-a621-5832abd0e312 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:59.697415 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-742cea43-ce97-46b3-a621-5832abd0e312 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:59.698417 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-742cea43-ce97-46b3-a621-5832abd0e312 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:59.699008 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-742cea43-ce97-46b3-a621-5832abd0e312 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:59.874089 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2f0eafc9-e493-4d0e-a88a-574f0454b532 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:24:59.874551 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2f0eafc9-e493-4d0e-a88a-574f0454b532 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:24:59.881754 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2f0eafc9-e493-4d0e-a88a-574f0454b532 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:59.882211 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2f0eafc9-e493-4d0e-a88a-574f0454b532 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:59.883452 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2f0eafc9-e493-4d0e-a88a-574f0454b532 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:24:59.883896 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2f0eafc9-e493-4d0e-a88a-574f0454b532 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:24:59.908785 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-742cea43-ce97-46b3-a621-5832abd0e312 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:59.918817 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-742cea43-ce97-46b3-a621-5832abd0e312 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87" status: 200 len: 1367 microversion: 2.1 time: 0.234445 May 23 17:24:59.921664 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 383/778] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:24:59 2022] GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87 => generated 1367 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:24:59.987285 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2f0eafc9-e493-4d0e-a88a-574f0454b532 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:24:59.995262 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2f0eafc9-e493-4d0e-a88a-574f0454b532 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449" status: 200 len: 1209 microversion: 2.1 time: 0.125716 May 23 17:24:59.995876 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 396/779] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:24:59 2022] GET /compute/v2.1/servers/a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449 => generated 1209 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:25:00.937388 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-26ae6c04-15e1-45d9-a043-f1f21e742088 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:25:00.937990 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-26ae6c04-15e1-45d9-a043-f1f21e742088 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 161b8434-8d45-4f38-b174-c2c2de66ec87] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:25:00.945124 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-26ae6c04-15e1-45d9-a043-f1f21e742088 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:00.945751 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-26ae6c04-15e1-45d9-a043-f1f21e742088 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:00.946558 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-26ae6c04-15e1-45d9-a043-f1f21e742088 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:00.947017 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-26ae6c04-15e1-45d9-a043-f1f21e742088 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:01.013642 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e609682f-bc5a-48c5-9888-a0fff4161210 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:25:01.015028 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-e609682f-bc5a-48c5-9888-a0fff4161210 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:25:01.021866 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e609682f-bc5a-48c5-9888-a0fff4161210 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:01.022788 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e609682f-bc5a-48c5-9888-a0fff4161210 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:01.023858 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e609682f-bc5a-48c5-9888-a0fff4161210 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:01.024506 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e609682f-bc5a-48c5-9888-a0fff4161210 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:01.129071 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e609682f-bc5a-48c5-9888-a0fff4161210 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:25:01.138647 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-e609682f-bc5a-48c5-9888-a0fff4161210 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449" status: 200 len: 1197 microversion: 2.1 time: 0.129619 May 23 17:25:01.139811 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 397/780] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:25:01 2022] GET /compute/v2.1/servers/a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449 => generated 1197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:25:01.216388 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-26ae6c04-15e1-45d9-a043-f1f21e742088 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:25:01.224488 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-26ae6c04-15e1-45d9-a043-f1f21e742088 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87" status: 200 len: 1367 microversion: 2.1 time: 0.291074 May 23 17:25:01.225150 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 384/781] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:25:00 2022] GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87 => generated 1367 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:25:02.086744 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-c0584c81-85e1-4eb2-b14c-f04500673473 req-705313fb-c355-44c5-bd23-53bb0f0182b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449", "tag": "5b7000cf-6dcc-49e8-9708-84b48edff5e4"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:25:02.095411 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-c0584c81-85e1-4eb2-b14c-f04500673473 req-705313fb-c355-44c5-bd23-53bb0f0182b6 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:02.095857 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-c0584c81-85e1-4eb2-b14c-f04500673473 req-705313fb-c355-44c5-bd23-53bb0f0182b6 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:02.107349 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-c0584c81-85e1-4eb2-b14c-f04500673473 req-705313fb-c355-44c5-bd23-53bb0f0182b6 service nova] Creating event network-changed:5b7000cf-6dcc-49e8-9708-84b48edff5e4 for instance a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449 on hv-cinder-84299 May 23 17:25:02.120032 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-c0584c81-85e1-4eb2-b14c-f04500673473 req-705313fb-c355-44c5-bd23-53bb0f0182b6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036966 May 23 17:25:02.120928 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 398/782] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:25:02.156239 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-02807615-0e07-4dba-a8a6-bc61ff78017a tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:25:02.156881 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-02807615-0e07-4dba-a8a6-bc61ff78017a tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:25:02.163613 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-02807615-0e07-4dba-a8a6-bc61ff78017a tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:02.164061 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-02807615-0e07-4dba-a8a6-bc61ff78017a tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:02.164866 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-02807615-0e07-4dba-a8a6-bc61ff78017a tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:02.165299 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-02807615-0e07-4dba-a8a6-bc61ff78017a tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:02.242279 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-8f4e8e0a-2adb-4214-8e31-e340535a780f tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:25:02.242992 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-8f4e8e0a-2adb-4214-8e31-e340535a780f tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 161b8434-8d45-4f38-b174-c2c2de66ec87] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:25:02.256741 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8f4e8e0a-2adb-4214-8e31-e340535a780f tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:02.257183 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8f4e8e0a-2adb-4214-8e31-e340535a780f tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:02.258201 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8f4e8e0a-2adb-4214-8e31-e340535a780f tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:02.258621 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8f4e8e0a-2adb-4214-8e31-e340535a780f tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:02.430854 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-02807615-0e07-4dba-a8a6-bc61ff78017a tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:25:02.439014 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-02807615-0e07-4dba-a8a6-bc61ff78017a tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449" status: 200 len: 1263 microversion: 2.1 time: 0.286661 May 23 17:25:02.439603 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 385/783] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:25:02 2022] GET /compute/v2.1/servers/a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449 => generated 1263 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:25:02.515653 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-8f4e8e0a-2adb-4214-8e31-e340535a780f tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:25:02.523311 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-8f4e8e0a-2adb-4214-8e31-e340535a780f tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87" status: 200 len: 1367 microversion: 2.1 time: 0.285213 May 23 17:25:02.523976 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 399/784] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:25:02 2022] GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87 => generated 1367 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:25:03.455980 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6ab02988-7e84-475c-b383-8e4ed639c0f7 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:25:03.456623 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6ab02988-7e84-475c-b383-8e4ed639c0f7 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:25:03.464528 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6ab02988-7e84-475c-b383-8e4ed639c0f7 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:03.465027 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6ab02988-7e84-475c-b383-8e4ed639c0f7 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:03.465821 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6ab02988-7e84-475c-b383-8e4ed639c0f7 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:03.466259 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6ab02988-7e84-475c-b383-8e4ed639c0f7 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:03.539893 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-7e49ffa0-949c-4db7-90c7-5bd720fca770 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:25:03.540589 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-7e49ffa0-949c-4db7-90c7-5bd720fca770 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 161b8434-8d45-4f38-b174-c2c2de66ec87] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:25:03.547390 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7e49ffa0-949c-4db7-90c7-5bd720fca770 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:03.547828 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7e49ffa0-949c-4db7-90c7-5bd720fca770 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:03.548627 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7e49ffa0-949c-4db7-90c7-5bd720fca770 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:03.549088 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7e49ffa0-949c-4db7-90c7-5bd720fca770 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:03.629335 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6ab02988-7e84-475c-b383-8e4ed639c0f7 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:25:03.637529 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6ab02988-7e84-475c-b383-8e4ed639c0f7 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449" status: 200 len: 1263 microversion: 2.1 time: 0.185874 May 23 17:25:03.638230 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 386/785] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:25:03 2022] GET /compute/v2.1/servers/a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449 => generated 1263 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:25:03.692528 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-7e49ffa0-949c-4db7-90c7-5bd720fca770 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:25:03.701027 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-7e49ffa0-949c-4db7-90c7-5bd720fca770 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87" status: 200 len: 1367 microversion: 2.1 time: 0.165295 May 23 17:25:03.701673 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 400/786] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:25:03 2022] GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:25:04.656337 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ff4330b2-a0e8-4e3b-a2d8-522eb5767f77 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:25:04.659459 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ff4330b2-a0e8-4e3b-a2d8-522eb5767f77 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:25:04.665786 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ff4330b2-a0e8-4e3b-a2d8-522eb5767f77 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:04.666346 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ff4330b2-a0e8-4e3b-a2d8-522eb5767f77 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:04.667301 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ff4330b2-a0e8-4e3b-a2d8-522eb5767f77 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:04.667732 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ff4330b2-a0e8-4e3b-a2d8-522eb5767f77 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:04.718259 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-fcc74b77-70db-43d1-9269-a5dc6fc7fa45 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:25:04.719591 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-fcc74b77-70db-43d1-9269-a5dc6fc7fa45 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 161b8434-8d45-4f38-b174-c2c2de66ec87] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:25:04.727139 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fcc74b77-70db-43d1-9269-a5dc6fc7fa45 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:04.727742 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fcc74b77-70db-43d1-9269-a5dc6fc7fa45 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:04.728959 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fcc74b77-70db-43d1-9269-a5dc6fc7fa45 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:04.731136 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fcc74b77-70db-43d1-9269-a5dc6fc7fa45 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:04.863074 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ff4330b2-a0e8-4e3b-a2d8-522eb5767f77 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:25:04.871279 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ff4330b2-a0e8-4e3b-a2d8-522eb5767f77 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449" status: 200 len: 1263 microversion: 2.1 time: 0.219728 May 23 17:25:04.872144 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 387/787] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:25:04 2022] GET /compute/v2.1/servers/a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449 => generated 1263 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:25:04.893005 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-fcc74b77-70db-43d1-9269-a5dc6fc7fa45 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:25:04.900768 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-fcc74b77-70db-43d1-9269-a5dc6fc7fa45 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87" status: 200 len: 1367 microversion: 2.1 time: 0.186696 May 23 17:25:04.901488 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 401/788] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:25:04 2022] GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:25:05.485336 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-ac9332b6-29ba-4f0e-8159-a6112ecae346 req-13404820-8c98-42ab-aee6-7914a170f65a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "161b8434-8d45-4f38-b174-c2c2de66ec87", "name": "network-vif-plugged", "status": "completed", "tag": "5c5448fe-8b65-44a3-ac1f-8c9ca3dcf82b"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:25:05.495162 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-ac9332b6-29ba-4f0e-8159-a6112ecae346 req-13404820-8c98-42ab-aee6-7914a170f65a service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:05.495609 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-ac9332b6-29ba-4f0e-8159-a6112ecae346 req-13404820-8c98-42ab-aee6-7914a170f65a service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:05.506883 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-ac9332b6-29ba-4f0e-8159-a6112ecae346 req-13404820-8c98-42ab-aee6-7914a170f65a service nova] Creating event network-vif-plugged:5c5448fe-8b65-44a3-ac1f-8c9ca3dcf82b for instance 161b8434-8d45-4f38-b174-c2c2de66ec87 on hv-cinder-84299 May 23 17:25:05.513480 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-ac9332b6-29ba-4f0e-8159-a6112ecae346 req-13404820-8c98-42ab-aee6-7914a170f65a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031466 May 23 17:25:05.514520 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 388/789] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:25:05.893306 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2c3583ec-5436-4a3e-93f8-73eed1786b4a tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:25:05.894232 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2c3583ec-5436-4a3e-93f8-73eed1786b4a tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:25:05.903834 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2c3583ec-5436-4a3e-93f8-73eed1786b4a tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:05.904290 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2c3583ec-5436-4a3e-93f8-73eed1786b4a tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:05.905168 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2c3583ec-5436-4a3e-93f8-73eed1786b4a tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:05.905606 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2c3583ec-5436-4a3e-93f8-73eed1786b4a tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:05.919046 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-76d2bdba-7330-47ac-b67c-0f79d646d06c tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:25:05.919747 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-76d2bdba-7330-47ac-b67c-0f79d646d06c tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 161b8434-8d45-4f38-b174-c2c2de66ec87] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:25:05.926369 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-76d2bdba-7330-47ac-b67c-0f79d646d06c tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:05.927067 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-76d2bdba-7330-47ac-b67c-0f79d646d06c tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:05.927840 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-76d2bdba-7330-47ac-b67c-0f79d646d06c tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:05.928281 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-76d2bdba-7330-47ac-b67c-0f79d646d06c tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:06.096690 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2c3583ec-5436-4a3e-93f8-73eed1786b4a tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:25:06.103449 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-76d2bdba-7330-47ac-b67c-0f79d646d06c tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:25:06.104643 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2c3583ec-5436-4a3e-93f8-73eed1786b4a tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449" status: 200 len: 1263 microversion: 2.1 time: 0.218304 May 23 17:25:06.105572 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 402/790] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:25:05 2022] GET /compute/v2.1/servers/a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449 => generated 1263 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:25:06.111569 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-76d2bdba-7330-47ac-b67c-0f79d646d06c tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87" status: 200 len: 1367 microversion: 2.1 time: 0.196996 May 23 17:25:06.112307 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 389/791] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:25:05 2022] GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87 => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:25:07.124443 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-60842ee1-8ec9-40e9-909c-0e61c79fda0c tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:25:07.125088 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-60842ee1-8ec9-40e9-909c-0e61c79fda0c tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:25:07.127122 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=2 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:25:07.131783 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2cf93cc9-622a-47b2-83ff-b13667d866ed tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:25:07.132402 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2cf93cc9-622a-47b2-83ff-b13667d866ed tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 161b8434-8d45-4f38-b174-c2c2de66ec87] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:25:07.133264 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-60842ee1-8ec9-40e9-909c-0e61c79fda0c tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:07.133716 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-60842ee1-8ec9-40e9-909c-0e61c79fda0c tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:07.134492 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-60842ee1-8ec9-40e9-909c-0e61c79fda0c tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:07.134934 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-60842ee1-8ec9-40e9-909c-0e61c79fda0c tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:07.139030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2cf93cc9-622a-47b2-83ff-b13667d866ed tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:07.139479 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2cf93cc9-622a-47b2-83ff-b13667d866ed tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:07.140238 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2cf93cc9-622a-47b2-83ff-b13667d866ed tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:07.140690 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2cf93cc9-622a-47b2-83ff-b13667d866ed tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:07.329185 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-60842ee1-8ec9-40e9-909c-0e61c79fda0c tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:25:07.333306 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2cf93cc9-622a-47b2-83ff-b13667d866ed tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:25:07.336644 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-60842ee1-8ec9-40e9-909c-0e61c79fda0c tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449" status: 200 len: 1263 microversion: 2.1 time: 0.217049 May 23 17:25:07.337216 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 403/792] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:25:07 2022] GET /compute/v2.1/servers/a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449 => generated 1263 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:25:07.341044 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2cf93cc9-622a-47b2-83ff-b13667d866ed tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87" status: 200 len: 1367 microversion: 2.1 time: 0.213385 May 23 17:25:07.341603 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 390/793] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:25:07 2022] GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87 => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:25:08.356309 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c9d39100-4c5d-42c2-8431-2e27eeebc51d tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:25:08.356995 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c9d39100-4c5d-42c2-8431-2e27eeebc51d tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:25:08.359457 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2bb0c2f1-ddb1-4d83-b498-6cdc84ded01d tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:25:08.360131 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2bb0c2f1-ddb1-4d83-b498-6cdc84ded01d tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 161b8434-8d45-4f38-b174-c2c2de66ec87] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:25:08.364644 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c9d39100-4c5d-42c2-8431-2e27eeebc51d tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:08.365173 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c9d39100-4c5d-42c2-8431-2e27eeebc51d tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:08.366029 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c9d39100-4c5d-42c2-8431-2e27eeebc51d tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:08.366490 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c9d39100-4c5d-42c2-8431-2e27eeebc51d tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:08.367540 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2bb0c2f1-ddb1-4d83-b498-6cdc84ded01d tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:08.368031 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2bb0c2f1-ddb1-4d83-b498-6cdc84ded01d tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:08.368898 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2bb0c2f1-ddb1-4d83-b498-6cdc84ded01d tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:08.369378 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2bb0c2f1-ddb1-4d83-b498-6cdc84ded01d tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:08.513153 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=2 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:25:08.548186 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=8 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:25:08.560223 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-c9d39100-4c5d-42c2-8431-2e27eeebc51d tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:25:08.563480 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2bb0c2f1-ddb1-4d83-b498-6cdc84ded01d tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:25:08.568052 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c9d39100-4c5d-42c2-8431-2e27eeebc51d tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449" status: 200 len: 1263 microversion: 2.1 time: 0.217498 May 23 17:25:08.569400 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 404/794] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:25:08 2022] GET /compute/v2.1/servers/a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449 => generated 1263 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:25:08.571244 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2bb0c2f1-ddb1-4d83-b498-6cdc84ded01d tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87" status: 200 len: 1557 microversion: 2.1 time: 0.216043 May 23 17:25:08.571958 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 391/795] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:25:08 2022] GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87 => generated 1557 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:25:08.587401 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-694e17dc-27bd-4130-abd3-f5bf67ba1279 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:25:08.587887 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-694e17dc-27bd-4130-abd3-f5bf67ba1279 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 161b8434-8d45-4f38-b174-c2c2de66ec87] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:25:08.594000 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-694e17dc-27bd-4130-abd3-f5bf67ba1279 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:08.594453 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-694e17dc-27bd-4130-abd3-f5bf67ba1279 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:08.595212 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-694e17dc-27bd-4130-abd3-f5bf67ba1279 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:08.595668 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-694e17dc-27bd-4130-abd3-f5bf67ba1279 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:08.672707 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-694e17dc-27bd-4130-abd3-f5bf67ba1279 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088983 May 23 17:25:08.673346 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 405/796] 10.222.0.46 () {58 vars in 1274 bytes} [Mon May 23 17:25:08 2022] GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:25:09.585216 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-733bf7e2-8b11-4d82-91d5-42c31ff0eae7 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:25:09.585796 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-733bf7e2-8b11-4d82-91d5-42c31ff0eae7 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:25:09.595315 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-733bf7e2-8b11-4d82-91d5-42c31ff0eae7 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:09.595811 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-733bf7e2-8b11-4d82-91d5-42c31ff0eae7 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:09.596577 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-733bf7e2-8b11-4d82-91d5-42c31ff0eae7 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:09.597088 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-733bf7e2-8b11-4d82-91d5-42c31ff0eae7 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:09.612234 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=12 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:25:09.617561 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-70544160-3584-40fa-9b87-a10824560db3 req-f162b5f0-6633-4cab-9fbc-6eb5c9cfb288 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "161b8434-8d45-4f38-b174-c2c2de66ec87", "tag": "5c5448fe-8b65-44a3-ac1f-8c9ca3dcf82b"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:25:09.626281 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-70544160-3584-40fa-9b87-a10824560db3 req-f162b5f0-6633-4cab-9fbc-6eb5c9cfb288 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:09.626728 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-70544160-3584-40fa-9b87-a10824560db3 req-f162b5f0-6633-4cab-9fbc-6eb5c9cfb288 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:09.638642 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-70544160-3584-40fa-9b87-a10824560db3 req-f162b5f0-6633-4cab-9fbc-6eb5c9cfb288 service nova] Creating event network-changed:5c5448fe-8b65-44a3-ac1f-8c9ca3dcf82b for instance 161b8434-8d45-4f38-b174-c2c2de66ec87 on hv-cinder-84299 May 23 17:25:09.644331 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-70544160-3584-40fa-9b87-a10824560db3 req-f162b5f0-6633-4cab-9fbc-6eb5c9cfb288 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032616 May 23 17:25:09.645697 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 406/797] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 17:25:10.081325 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-733bf7e2-8b11-4d82-91d5-42c31ff0eae7 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:25:10.089433 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-733bf7e2-8b11-4d82-91d5-42c31ff0eae7 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449" status: 200 len: 1263 microversion: 2.1 time: 0.508109 May 23 17:25:10.089991 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 392/798] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:25:09 2022] GET /compute/v2.1/servers/a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449 => generated 1263 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:25:11.111741 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-4227c622-e13d-43ab-a0c8-2a61bdb721fc tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:25:11.112861 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-4227c622-e13d-43ab-a0c8-2a61bdb721fc tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:25:11.122586 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4227c622-e13d-43ab-a0c8-2a61bdb721fc tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:11.123030 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4227c622-e13d-43ab-a0c8-2a61bdb721fc tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:11.123831 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4227c622-e13d-43ab-a0c8-2a61bdb721fc tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:11.124262 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4227c622-e13d-43ab-a0c8-2a61bdb721fc tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:11.271535 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-4227c622-e13d-43ab-a0c8-2a61bdb721fc tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:25:11.276682 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=100 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:25:11.283651 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-4227c622-e13d-43ab-a0c8-2a61bdb721fc tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449" status: 200 len: 1263 microversion: 2.1 time: 0.178864 May 23 17:25:11.284486 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 407/799] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:25:11 2022] GET /compute/v2.1/servers/a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449 => generated 1263 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:25:12.304917 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-975d1fcb-f94d-44e5-ab07-27b67c51d2bb tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:25:12.305546 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-975d1fcb-f94d-44e5-ab07-27b67c51d2bb tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:25:12.313775 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-975d1fcb-f94d-44e5-ab07-27b67c51d2bb tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:12.314218 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-975d1fcb-f94d-44e5-ab07-27b67c51d2bb tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:12.315143 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-975d1fcb-f94d-44e5-ab07-27b67c51d2bb tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:12.315600 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-975d1fcb-f94d-44e5-ab07-27b67c51d2bb tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:12.445712 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-975d1fcb-f94d-44e5-ab07-27b67c51d2bb tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:25:12.453487 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-975d1fcb-f94d-44e5-ab07-27b67c51d2bb tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449" status: 200 len: 1263 microversion: 2.1 time: 0.154878 May 23 17:25:12.454046 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 393/800] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:25:12 2022] GET /compute/v2.1/servers/a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449 => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:25:13.470520 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-1b90ec4f-58ce-43a6-8fff-bb9d5fdb7214 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:25:13.471131 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-1b90ec4f-58ce-43a6-8fff-bb9d5fdb7214 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:25:13.478129 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1b90ec4f-58ce-43a6-8fff-bb9d5fdb7214 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:13.478583 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1b90ec4f-58ce-43a6-8fff-bb9d5fdb7214 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:13.479361 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1b90ec4f-58ce-43a6-8fff-bb9d5fdb7214 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:13.479794 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1b90ec4f-58ce-43a6-8fff-bb9d5fdb7214 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:13.527334 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-f96bf354-4064-40af-bb47-b16c880e8251 req-d3653881-77a7-4c01-a934-b7693130550c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449", "name": "network-vif-plugged", "status": "completed", "tag": "5b7000cf-6dcc-49e8-9708-84b48edff5e4"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:25:13.537251 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-f96bf354-4064-40af-bb47-b16c880e8251 req-d3653881-77a7-4c01-a934-b7693130550c service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:13.537686 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-f96bf354-4064-40af-bb47-b16c880e8251 req-d3653881-77a7-4c01-a934-b7693130550c service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:13.549991 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-f96bf354-4064-40af-bb47-b16c880e8251 req-d3653881-77a7-4c01-a934-b7693130550c service nova] Creating event network-vif-plugged:5b7000cf-6dcc-49e8-9708-84b48edff5e4 for instance a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449 on hv-cinder-84299 May 23 17:25:13.555195 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-f96bf354-4064-40af-bb47-b16c880e8251 req-d3653881-77a7-4c01-a934-b7693130550c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031550 May 23 17:25:13.556282 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 394/801] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:25:13.625179 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-1b90ec4f-58ce-43a6-8fff-bb9d5fdb7214 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:25:13.633756 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-1b90ec4f-58ce-43a6-8fff-bb9d5fdb7214 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449" status: 200 len: 1263 microversion: 2.1 time: 0.167385 May 23 17:25:13.634562 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 408/802] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:25:13 2022] GET /compute/v2.1/servers/a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449 => generated 1263 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:25:14.657242 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2eb81b72-45ba-4387-904c-ec32a5111194 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:25:14.658399 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2eb81b72-45ba-4387-904c-ec32a5111194 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:25:14.669107 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2eb81b72-45ba-4387-904c-ec32a5111194 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:14.669861 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2eb81b72-45ba-4387-904c-ec32a5111194 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:14.671141 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2eb81b72-45ba-4387-904c-ec32a5111194 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:14.671855 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2eb81b72-45ba-4387-904c-ec32a5111194 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:14.812911 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2eb81b72-45ba-4387-904c-ec32a5111194 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:25:14.820924 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2eb81b72-45ba-4387-904c-ec32a5111194 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449" status: 200 len: 1263 microversion: 2.1 time: 0.171641 May 23 17:25:14.821533 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 395/803] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:25:14 2022] GET /compute/v2.1/servers/a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449 => generated 1263 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:25:15.841351 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-53f7c215-d785-4fff-8152-7fc63f94b6f6 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:25:15.841944 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-53f7c215-d785-4fff-8152-7fc63f94b6f6 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:25:15.852043 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-53f7c215-d785-4fff-8152-7fc63f94b6f6 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:15.852871 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-53f7c215-d785-4fff-8152-7fc63f94b6f6 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:15.854223 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-53f7c215-d785-4fff-8152-7fc63f94b6f6 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:15.854754 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-53f7c215-d785-4fff-8152-7fc63f94b6f6 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:15.995274 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-53f7c215-d785-4fff-8152-7fc63f94b6f6 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:25:16.006997 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-53f7c215-d785-4fff-8152-7fc63f94b6f6 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449" status: 200 len: 1449 microversion: 2.1 time: 0.172116 May 23 17:25:16.007769 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 409/804] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:25:15 2022] GET /compute/v2.1/servers/a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449 => generated 1449 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:25:16.025613 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d341349e-8d9e-47f5-a9c1-fad5e94f1033 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:25:16.026160 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d341349e-8d9e-47f5-a9c1-fad5e94f1033 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:25:16.033490 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d341349e-8d9e-47f5-a9c1-fad5e94f1033 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:16.033941 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d341349e-8d9e-47f5-a9c1-fad5e94f1033 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:16.034701 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d341349e-8d9e-47f5-a9c1-fad5e94f1033 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:16.035134 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d341349e-8d9e-47f5-a9c1-fad5e94f1033 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:16.194010 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d341349e-8d9e-47f5-a9c1-fad5e94f1033 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:25:16.202146 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d341349e-8d9e-47f5-a9c1-fad5e94f1033 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449" status: 200 len: 1449 microversion: 2.1 time: 0.180624 May 23 17:25:16.202732 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 396/805] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:25:16 2022] GET /compute/v2.1/servers/a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449 => generated 1449 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:25:18.033049 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-a1c54877-7719-4442-947e-e8a4d05cdc0d req-6010973c-52e3-4fab-ab6f-770958764c6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449", "tag": "5b7000cf-6dcc-49e8-9708-84b48edff5e4"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:25:18.041693 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-a1c54877-7719-4442-947e-e8a4d05cdc0d req-6010973c-52e3-4fab-ab6f-770958764c6c service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:18.042134 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-a1c54877-7719-4442-947e-e8a4d05cdc0d req-6010973c-52e3-4fab-ab6f-770958764c6c service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:18.054912 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-a1c54877-7719-4442-947e-e8a4d05cdc0d req-6010973c-52e3-4fab-ab6f-770958764c6c service nova] Creating event network-changed:5b7000cf-6dcc-49e8-9708-84b48edff5e4 for instance a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449 on hv-cinder-84299 May 23 17:25:18.059880 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-a1c54877-7719-4442-947e-e8a4d05cdc0d req-6010973c-52e3-4fab-ab6f-770958764c6c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030791 May 23 17:25:18.060471 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 410/806] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:25:38.022952 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-25db9038-d080-4510-82e4-e2f425513c03 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:25:38.023900 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-25db9038-d080-4510-82e4-e2f425513c03 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:25:38.027569 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:25:38.029011 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=79 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:25:38.035786 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-25db9038-d080-4510-82e4-e2f425513c03 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:38.036241 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-25db9038-d080-4510-82e4-e2f425513c03 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:38.037044 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-25db9038-d080-4510-82e4-e2f425513c03 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:38.037482 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-25db9038-d080-4510-82e4-e2f425513c03 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:38.121267 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.objects.instance [None req-25db9038-d080-4510-82e4-e2f425513c03 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lazy-loading 'services' on Instance uuid 566ee1b1-7455-4a79-84ad-a954fc6a6a96 {{(pid=117909) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 17:25:38.200575 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-25db9038-d080-4510-82e4-e2f425513c03 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "DELETE /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96/os-volume_attachments/1abb710b-3a0e-491d-8365-569b260f1453" status: 202 len: 0 microversion: 2.1 time: 0.184329 May 23 17:25:38.201277 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 397/807] 10.222.0.46 () {58 vars in 1415 bytes} [Mon May 23 17:25:38 2022] DELETE /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96/os-volume_attachments/1abb710b-3a0e-491d-8365-569b260f1453 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 17:25:39.321972 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=31 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:25:39.322735 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=14 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:25:39.327549 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e1aecd16-1733-44e9-96bf-494ae213447b tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:25:39.334486 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e1aecd16-1733-44e9-96bf-494ae213447b tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:39.334929 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e1aecd16-1733-44e9-96bf-494ae213447b tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:39.393085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-e1aecd16-1733-44e9-96bf-494ae213447b tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Going to try to stop instance {{(pid=117910) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 23 17:25:39.439412 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-e1aecd16-1733-44e9-96bf-494ae213447b tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "POST /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96/action" status: 202 len: 0 microversion: 2.1 time: 0.119142 May 23 17:25:39.439982 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 411/808] 10.222.0.46 () {60 vars in 1277 bytes} [Mon May 23 17:25:39 2022] POST /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 17:25:39.450350 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8c6f2b63-cb3a-4072-a99d-49518797fe20 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:25:39.451048 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8c6f2b63-cb3a-4072-a99d-49518797fe20 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:25:39.457941 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8c6f2b63-cb3a-4072-a99d-49518797fe20 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:39.458428 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8c6f2b63-cb3a-4072-a99d-49518797fe20 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:39.459170 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8c6f2b63-cb3a-4072-a99d-49518797fe20 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:39.460178 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8c6f2b63-cb3a-4072-a99d-49518797fe20 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:39.600765 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8c6f2b63-cb3a-4072-a99d-49518797fe20 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:25:39.611917 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8c6f2b63-cb3a-4072-a99d-49518797fe20 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1678 microversion: 2.1 time: 0.165843 May 23 17:25:39.612751 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 398/809] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:25:39 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:25:40.638739 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-8fa37b14-bb1c-4e11-af47-ae11f9b3cb27 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:25:40.639815 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-8fa37b14-bb1c-4e11-af47-ae11f9b3cb27 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:25:40.646918 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8fa37b14-bb1c-4e11-af47-ae11f9b3cb27 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:40.647365 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8fa37b14-bb1c-4e11-af47-ae11f9b3cb27 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:40.648127 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8fa37b14-bb1c-4e11-af47-ae11f9b3cb27 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:40.648563 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8fa37b14-bb1c-4e11-af47-ae11f9b3cb27 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:40.779751 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-8fa37b14-bb1c-4e11-af47-ae11f9b3cb27 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:25:40.788003 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-8fa37b14-bb1c-4e11-af47-ae11f9b3cb27 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1678 microversion: 2.1 time: 0.156878 May 23 17:25:40.788591 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 412/810] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:25:40 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:25:41.810009 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6a131ee4-ada1-4484-83b5-7400e4b4e9c9 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:25:41.811016 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6a131ee4-ada1-4484-83b5-7400e4b4e9c9 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:25:41.818167 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6a131ee4-ada1-4484-83b5-7400e4b4e9c9 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:41.818615 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6a131ee4-ada1-4484-83b5-7400e4b4e9c9 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:41.819376 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6a131ee4-ada1-4484-83b5-7400e4b4e9c9 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:41.819810 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6a131ee4-ada1-4484-83b5-7400e4b4e9c9 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:41.951354 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6a131ee4-ada1-4484-83b5-7400e4b4e9c9 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:25:41.960080 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6a131ee4-ada1-4484-83b5-7400e4b4e9c9 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1678 microversion: 2.1 time: 0.156760 May 23 17:25:41.960679 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 399/811] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:25:41 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:25:42.980349 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-9a9b13bd-c6a3-4d01-84bc-2dcd08c36655 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:25:42.981004 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-9a9b13bd-c6a3-4d01-84bc-2dcd08c36655 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:25:42.989006 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9a9b13bd-c6a3-4d01-84bc-2dcd08c36655 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:42.989424 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9a9b13bd-c6a3-4d01-84bc-2dcd08c36655 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:42.990222 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9a9b13bd-c6a3-4d01-84bc-2dcd08c36655 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:42.990649 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9a9b13bd-c6a3-4d01-84bc-2dcd08c36655 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:43.141696 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9a9b13bd-c6a3-4d01-84bc-2dcd08c36655 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:25:43.151052 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-9a9b13bd-c6a3-4d01-84bc-2dcd08c36655 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1678 microversion: 2.1 time: 0.176992 May 23 17:25:43.151638 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 413/812] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:25:42 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1678 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:25:44.171887 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-110ea469-3c57-42c3-bfe9-a5c84516e057 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:25:44.172835 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-110ea469-3c57-42c3-bfe9-a5c84516e057 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:25:44.181357 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-110ea469-3c57-42c3-bfe9-a5c84516e057 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:44.181917 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-110ea469-3c57-42c3-bfe9-a5c84516e057 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:44.182878 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-110ea469-3c57-42c3-bfe9-a5c84516e057 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:44.183424 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-110ea469-3c57-42c3-bfe9-a5c84516e057 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:44.351787 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-110ea469-3c57-42c3-bfe9-a5c84516e057 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:25:44.362754 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-110ea469-3c57-42c3-bfe9-a5c84516e057 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1678 microversion: 2.1 time: 0.197390 May 23 17:25:44.363329 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 400/813] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:25:44 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1678 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:25:45.384839 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-3dfd515e-ba8e-466d-ab58-8b9b88a5276e tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:25:45.385795 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-3dfd515e-ba8e-466d-ab58-8b9b88a5276e tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:25:45.397129 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3dfd515e-ba8e-466d-ab58-8b9b88a5276e tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:45.397877 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3dfd515e-ba8e-466d-ab58-8b9b88a5276e tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:45.399150 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3dfd515e-ba8e-466d-ab58-8b9b88a5276e tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:45.399871 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3dfd515e-ba8e-466d-ab58-8b9b88a5276e tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:45.548289 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-3dfd515e-ba8e-466d-ab58-8b9b88a5276e tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:25:45.556461 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-3dfd515e-ba8e-466d-ab58-8b9b88a5276e tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1678 microversion: 2.1 time: 0.178159 May 23 17:25:45.557055 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 414/814] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:25:45 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:25:45.588414 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-38269492-84db-496a-9241-cee44922d9f1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:25:45.589008 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-38269492-84db-496a-9241-cee44922d9f1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 161b8434-8d45-4f38-b174-c2c2de66ec87] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:25:45.597778 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-38269492-84db-496a-9241-cee44922d9f1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:45.598428 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-38269492-84db-496a-9241-cee44922d9f1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:45.599640 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-38269492-84db-496a-9241-cee44922d9f1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:45.600272 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-38269492-84db-496a-9241-cee44922d9f1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:45.627010 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-38269492-84db-496a-9241-cee44922d9f1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87/ips" status: 200 len: 149 microversion: 2.1 time: 0.042633 May 23 17:25:45.627610 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 401/815] 10.222.0.46 () {58 vars in 1247 bytes} [Mon May 23 17:25:45 2022] GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:25:46.577759 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-549171a8-b421-485d-85a9-24817833c159 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:25:46.578823 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-549171a8-b421-485d-85a9-24817833c159 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:25:46.586878 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-549171a8-b421-485d-85a9-24817833c159 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:46.587331 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-549171a8-b421-485d-85a9-24817833c159 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:46.588104 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-549171a8-b421-485d-85a9-24817833c159 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:46.588543 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-549171a8-b421-485d-85a9-24817833c159 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:46.730892 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-549171a8-b421-485d-85a9-24817833c159 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:25:46.738921 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-549171a8-b421-485d-85a9-24817833c159 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1678 microversion: 2.1 time: 0.167788 May 23 17:25:46.739515 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 415/816] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:25:46 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:25:46.991486 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ce56087c-5771-48db-8d4b-5086740758ba tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d17d27c-b124-4e52-bbe0-68f258385938"}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:25:46.992633 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ce56087c-5771-48db-8d4b-5086740758ba tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 161b8434-8d45-4f38-b174-c2c2de66ec87] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:25:46.999545 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ce56087c-5771-48db-8d4b-5086740758ba tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:47.000006 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ce56087c-5771-48db-8d4b-5086740758ba tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:47.000811 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ce56087c-5771-48db-8d4b-5086740758ba tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:47.001252 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ce56087c-5771-48db-8d4b-5086740758ba tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:47.287712 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ce56087c-5771-48db-8d4b-5086740758ba tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "POST /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300749 May 23 17:25:47.288332 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 402/817] 10.222.0.46 () {60 vars in 1322 bytes} [Mon May 23 17:25:46 2022] POST /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:25:47.756468 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-72120915-8eb2-4dd0-8d2d-e5cb6019c851 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:25:47.757173 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-72120915-8eb2-4dd0-8d2d-e5cb6019c851 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:25:47.764342 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-72120915-8eb2-4dd0-8d2d-e5cb6019c851 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:47.764832 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-72120915-8eb2-4dd0-8d2d-e5cb6019c851 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:47.765607 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-72120915-8eb2-4dd0-8d2d-e5cb6019c851 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:47.766042 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-72120915-8eb2-4dd0-8d2d-e5cb6019c851 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:47.898250 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-72120915-8eb2-4dd0-8d2d-e5cb6019c851 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:25:47.906484 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-72120915-8eb2-4dd0-8d2d-e5cb6019c851 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1678 microversion: 2.1 time: 0.154218 May 23 17:25:47.907056 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 416/818] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:25:47 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:25:48.929797 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f34c1beb-0180-4e59-8c2f-97141cd0ec07 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:25:48.930982 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f34c1beb-0180-4e59-8c2f-97141cd0ec07 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:25:48.941758 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f34c1beb-0180-4e59-8c2f-97141cd0ec07 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:48.942212 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f34c1beb-0180-4e59-8c2f-97141cd0ec07 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:48.942989 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f34c1beb-0180-4e59-8c2f-97141cd0ec07 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:48.943430 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f34c1beb-0180-4e59-8c2f-97141cd0ec07 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:49.072945 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f34c1beb-0180-4e59-8c2f-97141cd0ec07 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:25:49.080517 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f34c1beb-0180-4e59-8c2f-97141cd0ec07 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1678 microversion: 2.1 time: 0.158922 May 23 17:25:49.081123 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 403/819] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:25:48 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:25:50.103987 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-27dacd19-3444-44b0-b7ad-eb225e04ba80 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:25:50.104563 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-27dacd19-3444-44b0-b7ad-eb225e04ba80 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:25:50.111850 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-27dacd19-3444-44b0-b7ad-eb225e04ba80 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:50.112297 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-27dacd19-3444-44b0-b7ad-eb225e04ba80 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:50.113095 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-27dacd19-3444-44b0-b7ad-eb225e04ba80 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:50.113843 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-27dacd19-3444-44b0-b7ad-eb225e04ba80 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:50.279031 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-27dacd19-3444-44b0-b7ad-eb225e04ba80 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:25:50.290799 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-27dacd19-3444-44b0-b7ad-eb225e04ba80 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1655 microversion: 2.1 time: 0.192256 May 23 17:25:50.291522 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 417/820] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:25:50 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1655 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:25:50.311419 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-57b01788-06a2-4fa6-99b2-508b99cf24b0 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:25:50.318635 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-57b01788-06a2-4fa6-99b2-508b99cf24b0 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:50.319015 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-57b01788-06a2-4fa6-99b2-508b99cf24b0 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:50.341396 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-57b01788-06a2-4fa6-99b2-508b99cf24b0 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Going to try to start instance {{(pid=117909) start /opt/stack/nova/nova/compute/api.py:2730}} May 23 17:25:50.386904 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-57b01788-06a2-4fa6-99b2-508b99cf24b0 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "POST /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96/action" status: 202 len: 0 microversion: 2.1 time: 0.078965 May 23 17:25:50.387503 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 404/821] 10.222.0.46 () {60 vars in 1277 bytes} [Mon May 23 17:25:50 2022] POST /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 17:25:50.395685 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-3563660d-d544-4883-bff1-1975a6ca7920 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:25:50.396363 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-3563660d-d544-4883-bff1-1975a6ca7920 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:25:50.402423 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3563660d-d544-4883-bff1-1975a6ca7920 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:50.402875 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3563660d-d544-4883-bff1-1975a6ca7920 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:50.403640 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3563660d-d544-4883-bff1-1975a6ca7920 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:50.404079 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3563660d-d544-4883-bff1-1975a6ca7920 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:50.574521 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-3563660d-d544-4883-bff1-1975a6ca7920 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:25:50.582861 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-3563660d-d544-4883-bff1-1975a6ca7920 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1664 microversion: 2.1 time: 0.191001 May 23 17:25:50.583439 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 418/822] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:25:50 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1664 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:25:51.602059 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f201a0ed-0479-4dc9-9ed0-588e992335d0 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:25:51.602641 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f201a0ed-0479-4dc9-9ed0-588e992335d0 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:25:51.610140 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f201a0ed-0479-4dc9-9ed0-588e992335d0 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:51.610592 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f201a0ed-0479-4dc9-9ed0-588e992335d0 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:51.611374 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f201a0ed-0479-4dc9-9ed0-588e992335d0 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:51.611863 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f201a0ed-0479-4dc9-9ed0-588e992335d0 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:51.749257 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f201a0ed-0479-4dc9-9ed0-588e992335d0 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:25:51.756901 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f201a0ed-0479-4dc9-9ed0-588e992335d0 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1664 microversion: 2.1 time: 0.160017 May 23 17:25:51.757514 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 405/823] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:25:51 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1664 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:25:52.778891 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-45e84e49-4faa-474f-9a07-80559c195b7b tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:25:52.779509 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-45e84e49-4faa-474f-9a07-80559c195b7b tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:25:52.786275 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-45e84e49-4faa-474f-9a07-80559c195b7b tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:52.786759 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-45e84e49-4faa-474f-9a07-80559c195b7b tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:52.787547 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-45e84e49-4faa-474f-9a07-80559c195b7b tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:52.787986 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-45e84e49-4faa-474f-9a07-80559c195b7b tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:52.970854 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-45e84e49-4faa-474f-9a07-80559c195b7b tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:25:52.979176 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-45e84e49-4faa-474f-9a07-80559c195b7b tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1668 microversion: 2.1 time: 0.203980 May 23 17:25:52.979750 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 419/824] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:25:52 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1668 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:25:53.786280 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c1129925-fe8c-4476-b588-c30fd3011770 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Action: 'create', calling method: .version_select at 0x7fd7a502c700>, body: {"keypair": {"name": "tempest-keypair-1221795149", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+caeNqpwpfUceKcgZPad8cHe1itD7do9usDkQsCEVOeH/SPI1ofARHRi0PRSTlNJKW2BmWKfd8Ac2uFjbVlVAIrpu8PDmW45kpOWzRZAyQ+vJOrBRh2BvCPgV/MMs7uw=="}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:25:53.801270 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-c1129925-fe8c-4476-b588-c30fd3011770 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Getting quotas for project 43c5da8fa182486990154b6f22539593. Resources: {'key_pairs'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 17:25:53.805429 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-c1129925-fe8c-4476-b588-c30fd3011770 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Getting quotas for user b4780bb497234a249b6d23afdab14370 and project 43c5da8fa182486990154b6f22539593. Resources: {'key_pairs'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 17:25:53.829712 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c1129925-fe8c-4476-b588-c30fd3011770 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047460 May 23 17:25:53.830306 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 406/825] 10.222.0.46 () {60 vars in 1158 bytes} [Mon May 23 17:25:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:25:55.116096 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a720f1fd-f19e-4e60-9e41-235e83020022 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-993731986", "imageRef": "99870172-61a4-4218-9407-6a6da3fb5c83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5796957f-d0fc-4cb4-b196-c5a4f17f1ba0"}], "security_groups": [{"name": "tempest-securitygroup--1479586023"}], "key_name": "tempest-keypair-1221795149", "user_data": "}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:25:55.226800 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.network.neutron [None req-a720f1fd-f19e-4e60-9e41-235e83020022 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] validate_networks() for [('5796957f-d0fc-4cb4-b196-c5a4f17f1ba0', None, None, None, None, None)] {{(pid=117910) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 17:25:55.593092 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-a720f1fd-f19e-4e60-9e41-235e83020022 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Flavor limits 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 17:25:55.593516 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-a720f1fd-f19e-4e60-9e41-235e83020022 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Image limits 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 17:25:55.594044 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-a720f1fd-f19e-4e60-9e41-235e83020022 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Flavor pref 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 17:25:55.594493 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-a720f1fd-f19e-4e60-9e41-235e83020022 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Image pref 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 17:25:55.595037 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-a720f1fd-f19e-4e60-9e41-235e83020022 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 17:25:55.604366 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a720f1fd-f19e-4e60-9e41-235e83020022 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:55.604888 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a720f1fd-f19e-4e60-9e41-235e83020022 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:55.605693 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a720f1fd-f19e-4e60-9e41-235e83020022 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:55.606135 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a720f1fd-f19e-4e60-9e41-235e83020022 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:55.622830 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-a720f1fd-f19e-4e60-9e41-235e83020022 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Getting quotas for project 43c5da8fa182486990154b6f22539593. Resources: {'cores', 'instances', 'ram'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 17:25:55.626835 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-a720f1fd-f19e-4e60-9e41-235e83020022 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Getting quotas for user b4780bb497234a249b6d23afdab14370 and project 43c5da8fa182486990154b6f22539593. Resources: {'cores', 'instances', 'ram'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 17:25:55.638672 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-a720f1fd-f19e-4e60-9e41-235e83020022 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Going to run 1 instances... {{(pid=117910) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 17:25:55.640987 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-a720f1fd-f19e-4e60-9e41-235e83020022 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 95a14987-7a38-406c-b32b-08c1a601f883] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99870172-61a4-4218-9407-6a6da3fb5c83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117910) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 17:25:55.690278 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-a720f1fd-f19e-4e60-9e41-235e83020022 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.578529 May 23 17:25:55.690930 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 420/826] 10.222.0.46 () {60 vars in 1146 bytes} [Mon May 23 17:25:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 17:25:55.702182 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-52ca3891-6e17-427b-8691-bf5c554a1394 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:25:55.702804 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-52ca3891-6e17-427b-8691-bf5c554a1394 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 95a14987-7a38-406c-b32b-08c1a601f883] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:25:55.755140 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-52ca3891-6e17-427b-8691-bf5c554a1394 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:25:55.763241 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-52ca3891-6e17-427b-8691-bf5c554a1394 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883" status: 200 len: 1241 microversion: 2.1 time: 0.065674 May 23 17:25:55.763824 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 407/827] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:25:55 2022] GET /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:25:56.779997 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-99f8f126-04e5-4644-8551-f975cb6ee8ab tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:25:56.780833 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-99f8f126-04e5-4644-8551-f975cb6ee8ab tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 95a14987-7a38-406c-b32b-08c1a601f883] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:25:56.788754 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-99f8f126-04e5-4644-8551-f975cb6ee8ab tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:56.789209 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-99f8f126-04e5-4644-8551-f975cb6ee8ab tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:56.789988 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-99f8f126-04e5-4644-8551-f975cb6ee8ab tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:56.790729 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-99f8f126-04e5-4644-8551-f975cb6ee8ab tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:56.886207 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-99f8f126-04e5-4644-8551-f975cb6ee8ab tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:25:56.896486 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-99f8f126-04e5-4644-8551-f975cb6ee8ab tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883" status: 200 len: 1299 microversion: 2.1 time: 0.120749 May 23 17:25:56.897286 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 421/828] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:25:56 2022] GET /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883 => generated 1299 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:25:57.915273 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1c815f23-d18a-4175-80e6-d8435507dfa3 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:25:57.916744 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1c815f23-d18a-4175-80e6-d8435507dfa3 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 95a14987-7a38-406c-b32b-08c1a601f883] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:25:57.923782 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1c815f23-d18a-4175-80e6-d8435507dfa3 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:57.924513 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1c815f23-d18a-4175-80e6-d8435507dfa3 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:57.925837 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1c815f23-d18a-4175-80e6-d8435507dfa3 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:57.926398 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1c815f23-d18a-4175-80e6-d8435507dfa3 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:58.137655 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-ab4b9b50-a5d5-498d-96f7-af75eba688ad req-25fbdf8d-543a-4450-b5a6-ba98808cb1ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95a14987-7a38-406c-b32b-08c1a601f883", "tag": "91811f2a-9b73-4873-996f-26f83d06734b"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:25:58.148730 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-ab4b9b50-a5d5-498d-96f7-af75eba688ad req-25fbdf8d-543a-4450-b5a6-ba98808cb1ac service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:58.149559 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-ab4b9b50-a5d5-498d-96f7-af75eba688ad req-25fbdf8d-543a-4450-b5a6-ba98808cb1ac service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:58.163180 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-ab4b9b50-a5d5-498d-96f7-af75eba688ad req-25fbdf8d-543a-4450-b5a6-ba98808cb1ac service nova] Creating event network-changed:91811f2a-9b73-4873-996f-26f83d06734b for instance 95a14987-7a38-406c-b32b-08c1a601f883 on hv-cinder-84299 May 23 17:25:58.165802 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1c815f23-d18a-4175-80e6-d8435507dfa3 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:25:58.169361 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-ab4b9b50-a5d5-498d-96f7-af75eba688ad req-25fbdf8d-543a-4450-b5a6-ba98808cb1ac service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036974 May 23 17:25:58.169978 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 422/829] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:25:58.177507 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1c815f23-d18a-4175-80e6-d8435507dfa3 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883" status: 200 len: 1367 microversion: 2.1 time: 0.266966 May 23 17:25:58.180640 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 408/830] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:25:57 2022] GET /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883 => generated 1367 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:25:59.200687 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-973e3856-a48b-4481-97e4-9064ac3433c1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:25:59.201836 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-973e3856-a48b-4481-97e4-9064ac3433c1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 95a14987-7a38-406c-b32b-08c1a601f883] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:25:59.211924 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-973e3856-a48b-4481-97e4-9064ac3433c1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:59.212361 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-973e3856-a48b-4481-97e4-9064ac3433c1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:59.213180 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-973e3856-a48b-4481-97e4-9064ac3433c1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:25:59.213622 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-973e3856-a48b-4481-97e4-9064ac3433c1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:25:59.363391 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-973e3856-a48b-4481-97e4-9064ac3433c1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:25:59.375556 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-973e3856-a48b-4481-97e4-9064ac3433c1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883" status: 200 len: 1367 microversion: 2.1 time: 0.182720 May 23 17:25:59.376316 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 423/831] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:25:59 2022] GET /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:26:00.397902 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4d5e8577-5c27-4147-9a56-803bfbebdf54 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:00.398778 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4d5e8577-5c27-4147-9a56-803bfbebdf54 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 95a14987-7a38-406c-b32b-08c1a601f883] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:00.410002 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4d5e8577-5c27-4147-9a56-803bfbebdf54 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:00.410728 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4d5e8577-5c27-4147-9a56-803bfbebdf54 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:00.411980 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4d5e8577-5c27-4147-9a56-803bfbebdf54 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:00.412756 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4d5e8577-5c27-4147-9a56-803bfbebdf54 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:00.543781 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4d5e8577-5c27-4147-9a56-803bfbebdf54 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:26:00.551303 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4d5e8577-5c27-4147-9a56-803bfbebdf54 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883" status: 200 len: 1367 microversion: 2.1 time: 0.160112 May 23 17:26:00.551923 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 409/832] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:26:00 2022] GET /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:26:01.571730 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-df3d0b90-9483-4ce9-bcbe-e33c6a9126f8 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:01.572449 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-df3d0b90-9483-4ce9-bcbe-e33c6a9126f8 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 95a14987-7a38-406c-b32b-08c1a601f883] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:01.580563 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-df3d0b90-9483-4ce9-bcbe-e33c6a9126f8 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:01.581130 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-df3d0b90-9483-4ce9-bcbe-e33c6a9126f8 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:01.582033 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-df3d0b90-9483-4ce9-bcbe-e33c6a9126f8 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:01.582555 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-df3d0b90-9483-4ce9-bcbe-e33c6a9126f8 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:01.723945 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-df3d0b90-9483-4ce9-bcbe-e33c6a9126f8 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:26:01.731784 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-df3d0b90-9483-4ce9-bcbe-e33c6a9126f8 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883" status: 200 len: 1367 microversion: 2.1 time: 0.166017 May 23 17:26:01.732494 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 424/833] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:26:01 2022] GET /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:26:02.749316 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-df660b2f-b16d-425d-bdcb-27b230e84437 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:02.749910 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-df660b2f-b16d-425d-bdcb-27b230e84437 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 95a14987-7a38-406c-b32b-08c1a601f883] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:02.757182 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-df660b2f-b16d-425d-bdcb-27b230e84437 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:02.757614 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-df660b2f-b16d-425d-bdcb-27b230e84437 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:02.758377 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-df660b2f-b16d-425d-bdcb-27b230e84437 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:02.758804 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-df660b2f-b16d-425d-bdcb-27b230e84437 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:02.891899 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-df660b2f-b16d-425d-bdcb-27b230e84437 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:26:02.899558 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-df660b2f-b16d-425d-bdcb-27b230e84437 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883" status: 200 len: 1367 microversion: 2.1 time: 0.154193 May 23 17:26:02.900130 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 410/834] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:26:02 2022] GET /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:26:03.854428 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-593300ca-5403-48c2-a57c-bf5aa51cb0a8 req-1b746434-8227-4ec5-8847-4206efb066e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95a14987-7a38-406c-b32b-08c1a601f883", "name": "network-vif-plugged", "status": "completed", "tag": "91811f2a-9b73-4873-996f-26f83d06734b"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:26:03.862646 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-593300ca-5403-48c2-a57c-bf5aa51cb0a8 req-1b746434-8227-4ec5-8847-4206efb066e8 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:03.863091 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-593300ca-5403-48c2-a57c-bf5aa51cb0a8 req-1b746434-8227-4ec5-8847-4206efb066e8 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:03.874622 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-593300ca-5403-48c2-a57c-bf5aa51cb0a8 req-1b746434-8227-4ec5-8847-4206efb066e8 service nova] Creating event network-vif-plugged:91811f2a-9b73-4873-996f-26f83d06734b for instance 95a14987-7a38-406c-b32b-08c1a601f883 on hv-cinder-84299 May 23 17:26:03.879627 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-593300ca-5403-48c2-a57c-bf5aa51cb0a8 req-1b746434-8227-4ec5-8847-4206efb066e8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029028 May 23 17:26:03.880271 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 425/835] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:26:03.917601 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-564c65e8-ccbb-4908-85b1-93368e6ff1b6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:03.918222 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-564c65e8-ccbb-4908-85b1-93368e6ff1b6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 95a14987-7a38-406c-b32b-08c1a601f883] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:03.926424 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-564c65e8-ccbb-4908-85b1-93368e6ff1b6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:03.926907 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-564c65e8-ccbb-4908-85b1-93368e6ff1b6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:03.927664 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-564c65e8-ccbb-4908-85b1-93368e6ff1b6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:03.928094 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-564c65e8-ccbb-4908-85b1-93368e6ff1b6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:04.095302 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-564c65e8-ccbb-4908-85b1-93368e6ff1b6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:26:04.103204 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-564c65e8-ccbb-4908-85b1-93368e6ff1b6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883" status: 200 len: 1367 microversion: 2.1 time: 0.190257 May 23 17:26:04.104288 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 411/836] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:26:03 2022] GET /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:26:05.121876 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-9a495082-c36c-4540-bcf2-40f926e469bf tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:05.122610 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-9a495082-c36c-4540-bcf2-40f926e469bf tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 95a14987-7a38-406c-b32b-08c1a601f883] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:05.129282 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9a495082-c36c-4540-bcf2-40f926e469bf tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:05.129733 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9a495082-c36c-4540-bcf2-40f926e469bf tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:05.130503 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9a495082-c36c-4540-bcf2-40f926e469bf tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:05.130939 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9a495082-c36c-4540-bcf2-40f926e469bf tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:05.272338 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9a495082-c36c-4540-bcf2-40f926e469bf tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:26:05.280461 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-9a495082-c36c-4540-bcf2-40f926e469bf tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883" status: 200 len: 1367 microversion: 2.1 time: 0.163418 May 23 17:26:05.281055 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 426/837] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:26:05 2022] GET /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:26:06.301702 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3bbceb51-7d67-4e3b-9175-f7cb70d69da6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:06.302723 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3bbceb51-7d67-4e3b-9175-f7cb70d69da6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 95a14987-7a38-406c-b32b-08c1a601f883] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:06.306568 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=6 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:26:06.315481 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3bbceb51-7d67-4e3b-9175-f7cb70d69da6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:06.316239 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3bbceb51-7d67-4e3b-9175-f7cb70d69da6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:06.317551 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3bbceb51-7d67-4e3b-9175-f7cb70d69da6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:06.318392 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3bbceb51-7d67-4e3b-9175-f7cb70d69da6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:06.459339 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3bbceb51-7d67-4e3b-9175-f7cb70d69da6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:26:06.462885 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:26:06.467661 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3bbceb51-7d67-4e3b-9175-f7cb70d69da6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883" status: 200 len: 1557 microversion: 2.1 time: 0.172516 May 23 17:26:06.468236 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 412/838] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:26:06 2022] GET /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883 => generated 1557 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:26:06.484198 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-529331e2-c1f4-45f9-9e03-4d6e408586bc tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:06.484735 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-529331e2-c1f4-45f9-9e03-4d6e408586bc tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 95a14987-7a38-406c-b32b-08c1a601f883] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:06.486712 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=2 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:26:06.487382 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=6 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:26:06.493849 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-529331e2-c1f4-45f9-9e03-4d6e408586bc tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:06.494300 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-529331e2-c1f4-45f9-9e03-4d6e408586bc tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:06.495082 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-529331e2-c1f4-45f9-9e03-4d6e408586bc tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:06.495531 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-529331e2-c1f4-45f9-9e03-4d6e408586bc tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:06.571261 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-529331e2-c1f4-45f9-9e03-4d6e408586bc tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090952 May 23 17:26:06.571862 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 427/839] 10.222.0.46 () {58 vars in 1274 bytes} [Mon May 23 17:26:06 2022] GET /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:26:07.763844 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-a2e3439e-9727-4fa9-be87-7e39dffb144b req-31eacfbd-fb8c-4a53-9ecc-e7a703804718 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95a14987-7a38-406c-b32b-08c1a601f883", "tag": "91811f2a-9b73-4873-996f-26f83d06734b"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:26:07.773993 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-a2e3439e-9727-4fa9-be87-7e39dffb144b req-31eacfbd-fb8c-4a53-9ecc-e7a703804718 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:07.774280 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-a2e3439e-9727-4fa9-be87-7e39dffb144b req-31eacfbd-fb8c-4a53-9ecc-e7a703804718 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:07.787567 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-a2e3439e-9727-4fa9-be87-7e39dffb144b req-31eacfbd-fb8c-4a53-9ecc-e7a703804718 service nova] Creating event network-changed:91811f2a-9b73-4873-996f-26f83d06734b for instance 95a14987-7a38-406c-b32b-08c1a601f883 on hv-cinder-84299 May 23 17:26:07.791261 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-a2e3439e-9727-4fa9-be87-7e39dffb144b req-31eacfbd-fb8c-4a53-9ecc-e7a703804718 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031995 May 23 17:26:07.791843 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 413/840] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:26:25.626160 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:26:25.627036 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:26:25.631304 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-abf4274c-e5c6-4aa6-8155-58697e79449e tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:25.632230 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-abf4274c-e5c6-4aa6-8155-58697e79449e tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:25.640136 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-abf4274c-e5c6-4aa6-8155-58697e79449e tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:25.640618 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-abf4274c-e5c6-4aa6-8155-58697e79449e tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:25.641499 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-abf4274c-e5c6-4aa6-8155-58697e79449e tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:25.641955 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-abf4274c-e5c6-4aa6-8155-58697e79449e tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:25.672766 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-abf4274c-e5c6-4aa6-8155-58697e79449e tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047829 May 23 17:26:25.673321 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 428/841] 10.222.0.46 () {58 vars in 1301 bytes} [Mon May 23 17:26:25 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 17:26:25.738721 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:26:25.739493 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=2 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:26:25.743603 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-88c50d00-56b8-4e6a-bb56-c7c616af4ac2 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:25.744171 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-88c50d00-56b8-4e6a-bb56-c7c616af4ac2 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:25.751968 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-88c50d00-56b8-4e6a-bb56-c7c616af4ac2 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:25.752420 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-88c50d00-56b8-4e6a-bb56-c7c616af4ac2 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:25.753217 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-88c50d00-56b8-4e6a-bb56-c7c616af4ac2 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:25.753654 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-88c50d00-56b8-4e6a-bb56-c7c616af4ac2 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:25.781424 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-88c50d00-56b8-4e6a-bb56-c7c616af4ac2 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Going to try to terminate instance {{(pid=117909) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 17:26:25.861781 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-88c50d00-56b8-4e6a-bb56-c7c616af4ac2 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "DELETE /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 204 len: 0 microversion: 2.1 time: 0.124421 May 23 17:26:25.862551 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 414/842] 10.222.0.46 () {58 vars in 1238 bytes} [Mon May 23 17:26:25 2022] DELETE /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 17:26:25.871542 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b806eaae-f7be-4085-a0a1-ad2313701548 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:25.872156 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-b806eaae-f7be-4085-a0a1-ad2313701548 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:25.878414 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b806eaae-f7be-4085-a0a1-ad2313701548 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:25.878877 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b806eaae-f7be-4085-a0a1-ad2313701548 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:25.879637 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b806eaae-f7be-4085-a0a1-ad2313701548 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:25.880073 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b806eaae-f7be-4085-a0a1-ad2313701548 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:26.012735 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b806eaae-f7be-4085-a0a1-ad2313701548 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:26:26.020539 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b806eaae-f7be-4085-a0a1-ad2313701548 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1674 microversion: 2.1 time: 0.153101 May 23 17:26:26.021149 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 429/843] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:26:25 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:26:27.042980 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e06568b0-34da-4872-8202-a8bd09e33044 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:27.044192 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e06568b0-34da-4872-8202-a8bd09e33044 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:27.055212 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e06568b0-34da-4872-8202-a8bd09e33044 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:27.055855 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e06568b0-34da-4872-8202-a8bd09e33044 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:27.057288 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e06568b0-34da-4872-8202-a8bd09e33044 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:27.057735 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e06568b0-34da-4872-8202-a8bd09e33044 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:27.198099 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e06568b0-34da-4872-8202-a8bd09e33044 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:26:27.205696 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e06568b0-34da-4872-8202-a8bd09e33044 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1674 microversion: 2.1 time: 0.169928 May 23 17:26:27.206265 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 415/844] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:26:27 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1674 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:26:28.223390 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b0e666c8-0f61-4590-a2bf-d89b544d43ce tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:28.224009 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-b0e666c8-0f61-4590-a2bf-d89b544d43ce tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:28.231227 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b0e666c8-0f61-4590-a2bf-d89b544d43ce tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:28.231684 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b0e666c8-0f61-4590-a2bf-d89b544d43ce tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:28.232495 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b0e666c8-0f61-4590-a2bf-d89b544d43ce tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:28.232996 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b0e666c8-0f61-4590-a2bf-d89b544d43ce tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:28.436878 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b0e666c8-0f61-4590-a2bf-d89b544d43ce tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:26:28.445354 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b0e666c8-0f61-4590-a2bf-d89b544d43ce tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 200 len: 1674 microversion: 2.1 time: 0.225990 May 23 17:26:28.445960 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 430/845] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:26:28 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 1674 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:26:28.833976 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-8500a862-67f8-45ed-9eda-c8f72ed1cd4d req-53cf7adc-06df-485e-b463-1f0e6b305cbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "566ee1b1-7455-4a79-84ad-a954fc6a6a96", "name": "network-vif-deleted", "tag": "0b3502b6-a7d0-447b-8472-1ca6a83cc8cd"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:26:28.844068 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-8500a862-67f8-45ed-9eda-c8f72ed1cd4d req-53cf7adc-06df-485e-b463-1f0e6b305cbf service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:28.844846 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-8500a862-67f8-45ed-9eda-c8f72ed1cd4d req-53cf7adc-06df-485e-b463-1f0e6b305cbf service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:28.856878 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-8500a862-67f8-45ed-9eda-c8f72ed1cd4d req-53cf7adc-06df-485e-b463-1f0e6b305cbf service nova] Creating event network-vif-deleted:0b3502b6-a7d0-447b-8472-1ca6a83cc8cd for instance 566ee1b1-7455-4a79-84ad-a954fc6a6a96 on hv-cinder-84299 May 23 17:26:28.861863 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-8500a862-67f8-45ed-9eda-c8f72ed1cd4d req-53cf7adc-06df-485e-b463-1f0e6b305cbf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031741 May 23 17:26:28.862470 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 416/846] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:26:29.463160 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e4a4882a-a4f8-4bf0-8db7-027d250f0a91 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:29.463862 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-e4a4882a-a4f8-4bf0-8db7-027d250f0a91 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:29.470729 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e4a4882a-a4f8-4bf0-8db7-027d250f0a91 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:29.471183 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e4a4882a-a4f8-4bf0-8db7-027d250f0a91 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:29.472005 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e4a4882a-a4f8-4bf0-8db7-027d250f0a91 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:29.472451 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e4a4882a-a4f8-4bf0-8db7-027d250f0a91 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:29.487079 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-e4a4882a-a4f8-4bf0-8db7-027d250f0a91 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] HTTP exception thrown: Instance 566ee1b1-7455-4a79-84ad-a954fc6a6a96 could not be found. May 23 17:26:29.488852 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e4a4882a-a4f8-4bf0-8db7-027d250f0a91 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Request method failure captured: May 23 17:26:29.488852 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: request: GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 HTTP/1.1 May 23 17:26:29.488852 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept: application/json May 23 17:26:29.488852 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity May 23 17:26:29.488852 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Connection: close May 23 17:26:29.488852 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Length: 0 May 23 17:26:29.488852 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Type: application/json May 23 17:26:29.488852 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Host: 10.222.0.46 May 23 17:26:29.488852 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None May 23 17:26:29.488852 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.9 May 23 17:26:29.488852 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABii8MWau2OWjWGasfBQDC3wajHrbDXx2FwIG6MDVHKf8k25AnkioePrVTsqu8f3OSf-QCKjBISOw6wcTtEz4srRwQgqRw5LOpNVQ2wxafmwgeux4Kkf5QWluxIWiM91SC4T1LO8293oDCQD2o-MfEaIreZfySzGXigwQPd7S7riYnpsG0 May 23 17:26:29.488852 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Id: None May 23 17:26:29.488852 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Name: None May 23 17:26:29.488852 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed May 23 17:26:29.488852 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True May 23 17:26:29.488852 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default May 23 17:26:29.488852 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default May 23 17:26:29.488852 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Id: 054a5a15ef3c4200b1a78a890b077a53 May 23 17:26:29.488852 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-AttachVolumeTestJSON-395505802 May 23 17:26:29.488852 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Role: reader,member May 23 17:26:29.488852 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Roles: reader,member May 23 17:26:29.490355 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/054a5a15ef3c4200b1a78a890b077a53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/054a5a15ef3c4200b1a78a890b077a53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/054a5a15ef3c4200b1a78a890b077a53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_054a5a15ef3c4200b1a78a890b077a53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:26:29.490355 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-AttachVolumeTestJSON-395505802 May 23 17:26:29.490355 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 054a5a15ef3c4200b1a78a890b077a53 May 23 17:26:29.490355 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-AttachVolumeTestJSON-395505802 May 23 17:26:29.490355 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User: tempest-AttachVolumeTestJSON-395505802-project May 23 17:26:29.490355 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default May 23 17:26:29.490355 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default May 23 17:26:29.490355 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Id: 6943ae00467244228fa6ac90e48c4cce May 23 17:26:29.490355 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-AttachVolumeTestJSON-395505802-project May 23 17:26:29.490355 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: method: > May 23 17:26:29.490355 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: exception: Instance 566ee1b1-7455-4a79-84ad-a954fc6a6a96 could not be found. May 23 17:26:29.490355 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: action_args: {'id': '566ee1b1-7455-4a79-84ad-a954fc6a6a96'} May 23 17:26:29.493946 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:26:29.493946 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:26:29.493946 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:26:29.493946 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:26:29.493946 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:26:29.493946 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:26:29.493946 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:26:29.493946 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:26:29.493946 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:26:29.493946 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:26:29.493946 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 566ee1b1-7455-4a79-84ad-a954fc6a6a96 could not be found. May 23 17:26:29.493946 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:26:29.493946 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:26:29.493946 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:26:29.493946 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:26:29.493946 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:26:29.493946 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:26:29.493946 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:26:29.493946 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:26:29.493946 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:26:29.495537 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:26:29.495537 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 17:26:29.495537 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 17:26:29.495537 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:26:29.495537 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:26:29.495537 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:26:29.495537 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:26:29.495537 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 566ee1b1-7455-4a79-84ad-a954fc6a6a96 could not be found. May 23 17:26:29.495537 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:26:29.495537 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:26:29.495537 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:26:29.495537 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:26:29.495537 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:26:29.495537 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:26:29.495537 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:26:29.495537 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:26:29.495537 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 566ee1b1-7455-4a79-84ad-a954fc6a6a96 could not be found. May 23 17:26:29.495537 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:26:29.496724 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e4a4882a-a4f8-4bf0-8db7-027d250f0a91 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Returning 404 to user: Instance 566ee1b1-7455-4a79-84ad-a954fc6a6a96 could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:26:29.496724 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-e4a4882a-a4f8-4bf0-8db7-027d250f0a91 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 404 len: 111 microversion: 2.1 time: 0.031236 May 23 17:26:29.496724 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 431/847] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:26:29 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:26:29.502913 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8416522b-666f-470b-aa20-de81c41bc783 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '.version_select at 0x7fd793cc8d30>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:29.526743 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8416522b-666f-470b-aa20-de81c41bc783 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1139725027" status: 202 len: 0 microversion: 2.1 time: 0.028328 May 23 17:26:29.527338 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 417/848] 10.222.0.46 () {58 vars in 1220 bytes} [Mon May 23 17:26:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1139725027 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 17:26:30.140569 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-05d442c5-36af-43b7-aa9e-3754290d36c1 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Action: 'create', calling method: .version_select at 0x7fd7a04a3700>, body: {"keypair": {"name": "tempest-keypair-639944184", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEh1n4m4w/3M+cRoPGdOWDvh6g1BiTIsL8s8XpR6UfDHluxaKFPhsn9hUAKTRPcIJ1Gk5KkfJcL2iwqItLG4MGFycKLJX2xvDTVQNslI7106LzjjcP3sUzfPeEUNeVDeA=="}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:26:30.157304 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-05d442c5-36af-43b7-aa9e-3754290d36c1 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Getting quotas for project 054a5a15ef3c4200b1a78a890b077a53. Resources: {'key_pairs'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 17:26:30.162451 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-05d442c5-36af-43b7-aa9e-3754290d36c1 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Getting quotas for user 6943ae00467244228fa6ac90e48c4cce and project 054a5a15ef3c4200b1a78a890b077a53. Resources: {'key_pairs'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 17:26:30.190778 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-05d442c5-36af-43b7-aa9e-3754290d36c1 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.054200 May 23 17:26:30.191604 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 432/849] 10.222.0.46 () {60 vars in 1158 bytes} [Mon May 23 17:26:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:26:31.560997 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-aa8f42dd-124b-4cd6-a272-4a31b452c0c5 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-972084922", "imageRef": "99870172-61a4-4218-9407-6a6da3fb5c83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "86eea2f6-dd78-4689-a8d3-6c237bac4669"}], "security_groups": [{"name": "tempest-securitygroup--1613673312"}], "key_name": "tempest-keypair-639944184", "user_data": "}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:26:31.672391 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.network.neutron [None req-aa8f42dd-124b-4cd6-a272-4a31b452c0c5 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] validate_networks() for [('86eea2f6-dd78-4689-a8d3-6c237bac4669', None, None, None, None, None)] {{(pid=117909) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 17:26:32.064670 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-aa8f42dd-124b-4cd6-a272-4a31b452c0c5 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Flavor limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 17:26:32.065229 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-aa8f42dd-124b-4cd6-a272-4a31b452c0c5 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Image limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 17:26:32.065904 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-aa8f42dd-124b-4cd6-a272-4a31b452c0c5 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Flavor pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 17:26:32.066484 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-aa8f42dd-124b-4cd6-a272-4a31b452c0c5 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Image pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 17:26:32.067063 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-aa8f42dd-124b-4cd6-a272-4a31b452c0c5 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 17:26:32.077685 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aa8f42dd-124b-4cd6-a272-4a31b452c0c5 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:32.078128 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aa8f42dd-124b-4cd6-a272-4a31b452c0c5 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:32.078918 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aa8f42dd-124b-4cd6-a272-4a31b452c0c5 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:32.079348 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aa8f42dd-124b-4cd6-a272-4a31b452c0c5 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:32.097338 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-aa8f42dd-124b-4cd6-a272-4a31b452c0c5 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Getting quotas for project 054a5a15ef3c4200b1a78a890b077a53. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 17:26:32.101318 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-aa8f42dd-124b-4cd6-a272-4a31b452c0c5 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Getting quotas for user 6943ae00467244228fa6ac90e48c4cce and project 054a5a15ef3c4200b1a78a890b077a53. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 17:26:32.112794 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-aa8f42dd-124b-4cd6-a272-4a31b452c0c5 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Going to run 1 instances... {{(pid=117909) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 17:26:32.115149 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-aa8f42dd-124b-4cd6-a272-4a31b452c0c5 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: e5999132-3aae-47fa-a682-d7a15c98d074] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99870172-61a4-4218-9407-6a6da3fb5c83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 17:26:32.161462 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-aa8f42dd-124b-4cd6-a272-4a31b452c0c5 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.609165 May 23 17:26:32.167172 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 418/850] 10.222.0.46 () {60 vars in 1146 bytes} [Mon May 23 17:26:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 17:26:32.172667 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-0275353a-433a-4c62-b571-c62cc8a5365d tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:32.173280 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-0275353a-433a-4c62-b571-c62cc8a5365d tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: e5999132-3aae-47fa-a682-d7a15c98d074] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:32.234197 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-0275353a-433a-4c62-b571-c62cc8a5365d tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:26:32.241733 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-0275353a-433a-4c62-b571-c62cc8a5365d tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074" status: 200 len: 1236 microversion: 2.1 time: 0.073216 May 23 17:26:32.243008 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 433/851] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:26:32 2022] GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074 => generated 1236 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:26:33.261222 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ece1816f-cd8c-43d2-bdab-b1d317d9f61f tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:33.262270 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ece1816f-cd8c-43d2-bdab-b1d317d9f61f tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: e5999132-3aae-47fa-a682-d7a15c98d074] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:33.270475 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ece1816f-cd8c-43d2-bdab-b1d317d9f61f tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:33.271194 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ece1816f-cd8c-43d2-bdab-b1d317d9f61f tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:33.272141 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ece1816f-cd8c-43d2-bdab-b1d317d9f61f tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:33.272770 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ece1816f-cd8c-43d2-bdab-b1d317d9f61f tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:33.635366 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ece1816f-cd8c-43d2-bdab-b1d317d9f61f tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:26:33.646715 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ece1816f-cd8c-43d2-bdab-b1d317d9f61f tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074" status: 200 len: 1294 microversion: 2.1 time: 0.390438 May 23 17:26:33.647563 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 419/852] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:26:33 2022] GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074 => generated 1294 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:26:34.666530 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-6ec4c183-e630-4a50-a6dd-f8deaa36f736 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:34.667135 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-6ec4c183-e630-4a50-a6dd-f8deaa36f736 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: e5999132-3aae-47fa-a682-d7a15c98d074] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:34.673984 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6ec4c183-e630-4a50-a6dd-f8deaa36f736 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:34.674422 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6ec4c183-e630-4a50-a6dd-f8deaa36f736 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:34.675600 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6ec4c183-e630-4a50-a6dd-f8deaa36f736 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:34.676034 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6ec4c183-e630-4a50-a6dd-f8deaa36f736 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:34.887991 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-5215f288-9c86-4762-995f-ff66785e46ac req-038b050d-01f2-44d6-bda3-92587eded983 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5999132-3aae-47fa-a682-d7a15c98d074", "tag": "a83ba6f0-c446-4fd2-9984-03f38a1f8d01"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:26:34.899052 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-5215f288-9c86-4762-995f-ff66785e46ac req-038b050d-01f2-44d6-bda3-92587eded983 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:34.899618 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-5215f288-9c86-4762-995f-ff66785e46ac req-038b050d-01f2-44d6-bda3-92587eded983 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:34.912899 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-5215f288-9c86-4762-995f-ff66785e46ac req-038b050d-01f2-44d6-bda3-92587eded983 service nova] Creating event network-changed:a83ba6f0-c446-4fd2-9984-03f38a1f8d01 for instance e5999132-3aae-47fa-a682-d7a15c98d074 on hv-cinder-84299 May 23 17:26:34.919381 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-5215f288-9c86-4762-995f-ff66785e46ac req-038b050d-01f2-44d6-bda3-92587eded983 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036456 May 23 17:26:34.920167 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 420/853] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:26:34.955510 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-6ec4c183-e630-4a50-a6dd-f8deaa36f736 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:26:34.965361 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-6ec4c183-e630-4a50-a6dd-f8deaa36f736 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074" status: 200 len: 1362 microversion: 2.1 time: 0.302372 May 23 17:26:34.966386 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 434/854] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:26:34 2022] GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074 => generated 1362 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:26:35.988330 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a3b81f0d-a3cf-4383-a746-0070b28985cf tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:35.989546 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a3b81f0d-a3cf-4383-a746-0070b28985cf tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: e5999132-3aae-47fa-a682-d7a15c98d074] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:36.000325 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a3b81f0d-a3cf-4383-a746-0070b28985cf tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:36.001113 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a3b81f0d-a3cf-4383-a746-0070b28985cf tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:36.002388 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a3b81f0d-a3cf-4383-a746-0070b28985cf tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:36.003121 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a3b81f0d-a3cf-4383-a746-0070b28985cf tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:36.140396 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a3b81f0d-a3cf-4383-a746-0070b28985cf tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:26:36.148371 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a3b81f0d-a3cf-4383-a746-0070b28985cf tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074" status: 200 len: 1362 microversion: 2.1 time: 0.168103 May 23 17:26:36.148996 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 421/855] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:26:35 2022] GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:26:37.172395 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d2cbb639-5bcc-435f-90d5-a6c8ed10c5de tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:37.173478 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d2cbb639-5bcc-435f-90d5-a6c8ed10c5de tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: e5999132-3aae-47fa-a682-d7a15c98d074] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:37.185076 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d2cbb639-5bcc-435f-90d5-a6c8ed10c5de tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:37.185518 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d2cbb639-5bcc-435f-90d5-a6c8ed10c5de tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:37.186286 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d2cbb639-5bcc-435f-90d5-a6c8ed10c5de tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:37.186721 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d2cbb639-5bcc-435f-90d5-a6c8ed10c5de tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:37.317792 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d2cbb639-5bcc-435f-90d5-a6c8ed10c5de tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:26:37.325461 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d2cbb639-5bcc-435f-90d5-a6c8ed10c5de tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074" status: 200 len: 1362 microversion: 2.1 time: 0.162345 May 23 17:26:37.326023 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 435/856] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:26:37 2022] GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:26:38.353085 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f0bc90d2-666d-4eb2-b69c-ca01c35429ae tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:38.353907 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f0bc90d2-666d-4eb2-b69c-ca01c35429ae tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: e5999132-3aae-47fa-a682-d7a15c98d074] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:38.361747 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f0bc90d2-666d-4eb2-b69c-ca01c35429ae tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:38.362195 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f0bc90d2-666d-4eb2-b69c-ca01c35429ae tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:38.363048 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f0bc90d2-666d-4eb2-b69c-ca01c35429ae tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:38.363479 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f0bc90d2-666d-4eb2-b69c-ca01c35429ae tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:38.496329 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f0bc90d2-666d-4eb2-b69c-ca01c35429ae tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:26:38.503829 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f0bc90d2-666d-4eb2-b69c-ca01c35429ae tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074" status: 200 len: 1362 microversion: 2.1 time: 0.158911 May 23 17:26:38.504399 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 422/857] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:26:38 2022] GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:26:39.524193 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-3ae4326e-e1c5-48b3-bdc1-db51f5b3041b tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:39.524838 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-3ae4326e-e1c5-48b3-bdc1-db51f5b3041b tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: e5999132-3aae-47fa-a682-d7a15c98d074] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:39.532630 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3ae4326e-e1c5-48b3-bdc1-db51f5b3041b tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:39.533097 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3ae4326e-e1c5-48b3-bdc1-db51f5b3041b tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:39.533886 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3ae4326e-e1c5-48b3-bdc1-db51f5b3041b tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:39.534320 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3ae4326e-e1c5-48b3-bdc1-db51f5b3041b tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:39.664553 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-3ae4326e-e1c5-48b3-bdc1-db51f5b3041b tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:26:39.675659 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-3ae4326e-e1c5-48b3-bdc1-db51f5b3041b tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074" status: 200 len: 1362 microversion: 2.1 time: 0.157572 May 23 17:26:39.676345 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 436/858] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:26:39 2022] GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:26:40.044725 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-daaeb794-a9a4-4624-9044-f4f536ab8a3e req-4c3417ba-c400-41b5-9c30-c8b51c280824 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5999132-3aae-47fa-a682-d7a15c98d074", "name": "network-vif-plugged", "status": "completed", "tag": "a83ba6f0-c446-4fd2-9984-03f38a1f8d01"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:26:40.053956 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-daaeb794-a9a4-4624-9044-f4f536ab8a3e req-4c3417ba-c400-41b5-9c30-c8b51c280824 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:40.054394 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-daaeb794-a9a4-4624-9044-f4f536ab8a3e req-4c3417ba-c400-41b5-9c30-c8b51c280824 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:40.066777 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-daaeb794-a9a4-4624-9044-f4f536ab8a3e req-4c3417ba-c400-41b5-9c30-c8b51c280824 service nova] Creating event network-vif-plugged:a83ba6f0-c446-4fd2-9984-03f38a1f8d01 for instance e5999132-3aae-47fa-a682-d7a15c98d074 on hv-cinder-84299 May 23 17:26:40.072003 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-daaeb794-a9a4-4624-9044-f4f536ab8a3e req-4c3417ba-c400-41b5-9c30-c8b51c280824 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030785 May 23 17:26:40.072745 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 423/859] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:26:40.700096 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-7ce7acfc-04d4-412a-b158-94ab4cdf381d tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:40.701174 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-7ce7acfc-04d4-412a-b158-94ab4cdf381d tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: e5999132-3aae-47fa-a682-d7a15c98d074] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:40.708568 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7ce7acfc-04d4-412a-b158-94ab4cdf381d tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:40.709004 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7ce7acfc-04d4-412a-b158-94ab4cdf381d tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:40.709890 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7ce7acfc-04d4-412a-b158-94ab4cdf381d tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:40.710294 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7ce7acfc-04d4-412a-b158-94ab4cdf381d tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:40.843263 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-7ce7acfc-04d4-412a-b158-94ab4cdf381d tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:26:40.851447 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-7ce7acfc-04d4-412a-b158-94ab4cdf381d tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074" status: 200 len: 1362 microversion: 2.1 time: 0.157907 May 23 17:26:40.852001 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 437/860] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:26:40 2022] GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:26:41.869154 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d9d5fd09-5ea6-47ac-ac4b-9d03945a36ea tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:41.869849 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d9d5fd09-5ea6-47ac-ac4b-9d03945a36ea tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: e5999132-3aae-47fa-a682-d7a15c98d074] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:41.877098 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d9d5fd09-5ea6-47ac-ac4b-9d03945a36ea tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:41.877545 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d9d5fd09-5ea6-47ac-ac4b-9d03945a36ea tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:41.878335 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d9d5fd09-5ea6-47ac-ac4b-9d03945a36ea tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:41.878763 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d9d5fd09-5ea6-47ac-ac4b-9d03945a36ea tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:42.013080 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d9d5fd09-5ea6-47ac-ac4b-9d03945a36ea tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:26:42.021134 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d9d5fd09-5ea6-47ac-ac4b-9d03945a36ea tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074" status: 200 len: 1548 microversion: 2.1 time: 0.156306 May 23 17:26:42.021716 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 424/861] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:26:41 2022] GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:26:42.037558 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e2d3e767-5fc4-4d81-b6ea-91b028c28b8a tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:42.038108 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-e2d3e767-5fc4-4d81-b6ea-91b028c28b8a tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: e5999132-3aae-47fa-a682-d7a15c98d074] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:42.044883 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e2d3e767-5fc4-4d81-b6ea-91b028c28b8a tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:42.045333 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e2d3e767-5fc4-4d81-b6ea-91b028c28b8a tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:42.046214 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e2d3e767-5fc4-4d81-b6ea-91b028c28b8a tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:42.046646 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e2d3e767-5fc4-4d81-b6ea-91b028c28b8a tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:42.129320 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-e2d3e767-5fc4-4d81-b6ea-91b028c28b8a tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095485 May 23 17:26:42.129954 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 438/862] 10.222.0.46 () {58 vars in 1274 bytes} [Mon May 23 17:26:42 2022] GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:26:43.048296 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-15617115-99cb-4442-9ae8-c9cab6109bcb req-45ed818c-a443-4f7d-8ba4-ca40b2a2a522 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5999132-3aae-47fa-a682-d7a15c98d074", "tag": "a83ba6f0-c446-4fd2-9984-03f38a1f8d01"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:26:43.051844 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=2 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:26:43.052425 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=6 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:26:43.059300 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-15617115-99cb-4442-9ae8-c9cab6109bcb req-45ed818c-a443-4f7d-8ba4-ca40b2a2a522 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:43.059865 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-15617115-99cb-4442-9ae8-c9cab6109bcb req-45ed818c-a443-4f7d-8ba4-ca40b2a2a522 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:43.071644 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-15617115-99cb-4442-9ae8-c9cab6109bcb req-45ed818c-a443-4f7d-8ba4-ca40b2a2a522 service nova] Creating event network-changed:a83ba6f0-c446-4fd2-9984-03f38a1f8d01 for instance e5999132-3aae-47fa-a682-d7a15c98d074 on hv-cinder-84299 May 23 17:26:43.076623 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-15617115-99cb-4442-9ae8-c9cab6109bcb req-45ed818c-a443-4f7d-8ba4-ca40b2a2a522 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032104 May 23 17:26:43.077264 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 425/863] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:26:43.616038 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=6 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:26:43.620874 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a09cdee5-119f-44c8-9adb-99b7d9edfdde tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:43.621379 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-a09cdee5-119f-44c8-9adb-99b7d9edfdde tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 95a14987-7a38-406c-b32b-08c1a601f883] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:43.627898 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a09cdee5-119f-44c8-9adb-99b7d9edfdde tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:43.628349 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a09cdee5-119f-44c8-9adb-99b7d9edfdde tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:43.629153 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a09cdee5-119f-44c8-9adb-99b7d9edfdde tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:43.629589 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a09cdee5-119f-44c8-9adb-99b7d9edfdde tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:43.653723 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-a09cdee5-119f-44c8-9adb-99b7d9edfdde tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883/ips" status: 200 len: 150 microversion: 2.1 time: 0.038337 May 23 17:26:43.654516 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 439/864] 10.222.0.46 () {58 vars in 1247 bytes} [Mon May 23 17:26:43 2022] GET /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 17:26:43.666201 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b746cb7e-0e9d-4425-9408-78c156209e34 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d17d27c-b124-4e52-bbe0-68f258385938"}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:26:43.667357 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b746cb7e-0e9d-4425-9408-78c156209e34 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 95a14987-7a38-406c-b32b-08c1a601f883] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:43.673676 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b746cb7e-0e9d-4425-9408-78c156209e34 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:43.674122 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b746cb7e-0e9d-4425-9408-78c156209e34 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:43.674879 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b746cb7e-0e9d-4425-9408-78c156209e34 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:43.675303 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b746cb7e-0e9d-4425-9408-78c156209e34 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:43.756946 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-b746cb7e-0e9d-4425-9408-78c156209e34 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] HTTP exception thrown: Invalid volume: volume 5d17d27c-b124-4e52-bbe0-68f258385938 is already attached to instances: 161b8434-8d45-4f38-b174-c2c2de66ec87 May 23 17:26:43.758673 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b746cb7e-0e9d-4425-9408-78c156209e34 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Request method failure captured: May 23 17:26:43.758673 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: request: POST /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883/os-volume_attachments HTTP/1.1 May 23 17:26:43.758673 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept: application/json May 23 17:26:43.758673 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity May 23 17:26:43.758673 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Connection: close May 23 17:26:43.758673 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Length: 74 May 23 17:26:43.758673 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Type: application/json May 23 17:26:43.758673 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Host: 10.222.0.46 May 23 17:26:43.758673 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None May 23 17:26:43.758673 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.9 May 23 17:26:43.758673 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABii8NlLxi80dSOGWL-lavmFeqdu7SsvZyfTIUgOEBMGxHagzi4-1UBzzWbKQ8ofm4C3ey4lzhkyKgnXXkVv8I8JI8XYGl9o7m9yKgGHy9m_tm7J0ml_lU8wosqr4A40dh-VL78ZzvIVJ9JNStDlW1mMD3CLnYBqgsXfzf-XjoMWG-RrH8 May 23 17:26:43.758673 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Id: None May 23 17:26:43.758673 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Name: None May 23 17:26:43.758673 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed May 23 17:26:43.758673 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True May 23 17:26:43.758673 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default May 23 17:26:43.758673 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default May 23 17:26:43.758673 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Id: 43c5da8fa182486990154b6f22539593 May 23 17:26:43.758673 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-AttachVolumeNegativeTest-200847774 May 23 17:26:43.758673 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Role: reader,member May 23 17:26:43.758673 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Roles: reader,member May 23 17:26:43.760427 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43c5da8fa182486990154b6f22539593"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/43c5da8fa182486990154b6f22539593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43c5da8fa182486990154b6f22539593"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_43c5da8fa182486990154b6f22539593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:26:43.760427 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-AttachVolumeNegativeTest-200847774 May 23 17:26:43.760427 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 43c5da8fa182486990154b6f22539593 May 23 17:26:43.760427 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-200847774 May 23 17:26:43.760427 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User: tempest-AttachVolumeNegativeTest-200847774-project May 23 17:26:43.760427 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default May 23 17:26:43.760427 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default May 23 17:26:43.760427 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Id: b4780bb497234a249b6d23afdab14370 May 23 17:26:43.760427 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-AttachVolumeNegativeTest-200847774-project May 23 17:26:43.760427 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: May 23 17:26:43.760427 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: {"volumeAttachment": {"volumeId": "5d17d27c-b124-4e52-bbe0-68f258385938"}} May 23 17:26:43.760427 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: method: > May 23 17:26:43.761754 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: exception: Invalid volume: volume 5d17d27c-b124-4e52-bbe0-68f258385938 is already attached to instances: 161b8434-8d45-4f38-b174-c2c2de66ec87 May 23 17:26:43.761754 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: action_args: {'server_id': '95a14987-7a38-406c-b32b-08c1a601f883', 'body': {'volumeAttachment': {'volumeId': '5d17d27c-b124-4e52-bbe0-68f258385938'}}} May 23 17:26:43.761754 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:26:43.761754 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:26:43.761754 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 23 17:26:43.761754 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 23 17:26:43.761754 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 17:26:43.761754 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 17:26:43.761754 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 17:26:43.761754 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 17:26:43.761754 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 23 17:26:43.761754 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 23 17:26:43.761754 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 23 17:26:43.761754 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 23 17:26:43.761754 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5d17d27c-b124-4e52-bbe0-68f258385938 is already attached to instances: 161b8434-8d45-4f38-b174-c2c2de66ec87 May 23 17:26:43.761754 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:26:43.761754 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:26:43.761754 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:26:43.761754 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:26:43.763242 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:26:43.763242 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:26:43.763242 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:26:43.763242 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:26:43.763242 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:26:43.763242 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:26:43.763242 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 17:26:43.763242 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 17:26:43.763242 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 17:26:43.763242 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 17:26:43.763242 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 17:26:43.763242 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 17:26:43.763242 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 23 17:26:43.763242 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 17:26:43.763242 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5d17d27c-b124-4e52-bbe0-68f258385938 is already attached to instances: 161b8434-8d45-4f38-b174-c2c2de66ec87 May 23 17:26:43.763242 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:26:43.763242 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:26:43.763242 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:26:43.763242 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:26:43.763242 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:26:43.764815 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:26:43.764815 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:26:43.764815 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:26:43.764815 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5d17d27c-b124-4e52-bbe0-68f258385938 is already attached to instances: 161b8434-8d45-4f38-b174-c2c2de66ec87 May 23 17:26:43.764815 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:26:43.764815 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b746cb7e-0e9d-4425-9408-78c156209e34 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Returning 400 to user: Invalid volume: volume 5d17d27c-b124-4e52-bbe0-68f258385938 is already attached to instances: 161b8434-8d45-4f38-b174-c2c2de66ec87 {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:26:43.764815 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b746cb7e-0e9d-4425-9408-78c156209e34 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "POST /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098600 May 23 17:26:43.764815 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 426/865] 10.222.0.46 () {60 vars in 1322 bytes} [Mon May 23 17:26:43 2022] POST /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 17:26:43.769675 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-1c94c3a0-f3a0-4eed-9d6d-06448ead43f8 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:43.770171 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-1c94c3a0-f3a0-4eed-9d6d-06448ead43f8 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 95a14987-7a38-406c-b32b-08c1a601f883] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:43.776715 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1c94c3a0-f3a0-4eed-9d6d-06448ead43f8 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:43.777114 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1c94c3a0-f3a0-4eed-9d6d-06448ead43f8 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:43.777913 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1c94c3a0-f3a0-4eed-9d6d-06448ead43f8 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:43.778349 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1c94c3a0-f3a0-4eed-9d6d-06448ead43f8 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:43.804049 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-1c94c3a0-f3a0-4eed-9d6d-06448ead43f8 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 95a14987-7a38-406c-b32b-08c1a601f883] Going to try to terminate instance {{(pid=117910) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 17:26:43.885610 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-1c94c3a0-f3a0-4eed-9d6d-06448ead43f8 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "DELETE /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883" status: 204 len: 0 microversion: 2.1 time: 0.119505 May 23 17:26:43.886598 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 440/866] 10.222.0.46 () {58 vars in 1238 bytes} [Mon May 23 17:26:43 2022] DELETE /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 17:26:43.895365 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3165509e-0343-40d5-a4ee-103e9dd520db tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:43.895982 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3165509e-0343-40d5-a4ee-103e9dd520db tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 95a14987-7a38-406c-b32b-08c1a601f883] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:43.903339 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3165509e-0343-40d5-a4ee-103e9dd520db tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:43.903877 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3165509e-0343-40d5-a4ee-103e9dd520db tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:43.904745 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3165509e-0343-40d5-a4ee-103e9dd520db tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:43.905303 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3165509e-0343-40d5-a4ee-103e9dd520db tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:44.045324 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3165509e-0343-40d5-a4ee-103e9dd520db tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:26:44.053178 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3165509e-0343-40d5-a4ee-103e9dd520db tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883" status: 200 len: 1682 microversion: 2.1 time: 0.161617 May 23 17:26:44.053868 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 427/867] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:26:43 2022] GET /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:26:45.071884 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-46561851-c43b-4ac2-baf5-bb3085fdf2fd tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:45.072737 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-46561851-c43b-4ac2-baf5-bb3085fdf2fd tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 95a14987-7a38-406c-b32b-08c1a601f883] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:45.079743 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-46561851-c43b-4ac2-baf5-bb3085fdf2fd tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:45.080189 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-46561851-c43b-4ac2-baf5-bb3085fdf2fd tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:45.080987 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-46561851-c43b-4ac2-baf5-bb3085fdf2fd tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:45.081423 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-46561851-c43b-4ac2-baf5-bb3085fdf2fd tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:45.214917 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-46561851-c43b-4ac2-baf5-bb3085fdf2fd tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:26:45.227001 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-46561851-c43b-4ac2-baf5-bb3085fdf2fd tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883" status: 200 len: 1682 microversion: 2.1 time: 0.159425 May 23 17:26:45.227925 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 441/868] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:26:45 2022] GET /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:26:46.247055 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6c547459-d278-497c-b902-c24b27b50b3f tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:46.248357 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6c547459-d278-497c-b902-c24b27b50b3f tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 95a14987-7a38-406c-b32b-08c1a601f883] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:46.255944 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6c547459-d278-497c-b902-c24b27b50b3f tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:46.256831 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6c547459-d278-497c-b902-c24b27b50b3f tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:46.257806 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6c547459-d278-497c-b902-c24b27b50b3f tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:46.258401 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6c547459-d278-497c-b902-c24b27b50b3f tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:46.404332 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-c35bf093-6ffd-4ffe-8cd3-fe926ce088b2 req-08fb1d95-6825-4bd4-81de-05b045ba5c76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95a14987-7a38-406c-b32b-08c1a601f883", "name": "network-vif-deleted", "tag": "91811f2a-9b73-4873-996f-26f83d06734b"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:26:46.417214 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-c35bf093-6ffd-4ffe-8cd3-fe926ce088b2 req-08fb1d95-6825-4bd4-81de-05b045ba5c76 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:46.417666 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-c35bf093-6ffd-4ffe-8cd3-fe926ce088b2 req-08fb1d95-6825-4bd4-81de-05b045ba5c76 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:46.420058 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6c547459-d278-497c-b902-c24b27b50b3f tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:26:46.430018 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6c547459-d278-497c-b902-c24b27b50b3f tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883" status: 200 len: 1614 microversion: 2.1 time: 0.186886 May 23 17:26:46.431498 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-c35bf093-6ffd-4ffe-8cd3-fe926ce088b2 req-08fb1d95-6825-4bd4-81de-05b045ba5c76 service nova] Creating event network-vif-deleted:91811f2a-9b73-4873-996f-26f83d06734b for instance 95a14987-7a38-406c-b32b-08c1a601f883 on hv-cinder-84299 May 23 17:26:46.433176 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 428/869] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:26:46 2022] GET /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883 => generated 1614 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:26:46.455858 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-c35bf093-6ffd-4ffe-8cd3-fe926ce088b2 req-08fb1d95-6825-4bd4-81de-05b045ba5c76 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056159 May 23 17:26:46.456708 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 442/870] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:26:47.454080 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-758300ac-c1d5-4111-9dff-36b86d8aacb5 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:47.454732 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-758300ac-c1d5-4111-9dff-36b86d8aacb5 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 95a14987-7a38-406c-b32b-08c1a601f883] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:47.462956 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-758300ac-c1d5-4111-9dff-36b86d8aacb5 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:47.463493 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-758300ac-c1d5-4111-9dff-36b86d8aacb5 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:47.464398 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-758300ac-c1d5-4111-9dff-36b86d8aacb5 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:47.464971 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-758300ac-c1d5-4111-9dff-36b86d8aacb5 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:47.481049 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-758300ac-c1d5-4111-9dff-36b86d8aacb5 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] HTTP exception thrown: Instance 95a14987-7a38-406c-b32b-08c1a601f883 could not be found. May 23 17:26:47.482859 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-758300ac-c1d5-4111-9dff-36b86d8aacb5 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Request method failure captured: May 23 17:26:47.482859 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: request: GET /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883 HTTP/1.1 May 23 17:26:47.482859 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept: application/json May 23 17:26:47.482859 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity May 23 17:26:47.482859 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Connection: close May 23 17:26:47.482859 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Length: 0 May 23 17:26:47.482859 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Type: application/json May 23 17:26:47.482859 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Host: 10.222.0.46 May 23 17:26:47.482859 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None May 23 17:26:47.482859 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.9 May 23 17:26:47.482859 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABii8NlLxi80dSOGWL-lavmFeqdu7SsvZyfTIUgOEBMGxHagzi4-1UBzzWbKQ8ofm4C3ey4lzhkyKgnXXkVv8I8JI8XYGl9o7m9yKgGHy9m_tm7J0ml_lU8wosqr4A40dh-VL78ZzvIVJ9JNStDlW1mMD3CLnYBqgsXfzf-XjoMWG-RrH8 May 23 17:26:47.482859 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Id: None May 23 17:26:47.482859 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Name: None May 23 17:26:47.482859 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed May 23 17:26:47.482859 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True May 23 17:26:47.482859 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default May 23 17:26:47.482859 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default May 23 17:26:47.482859 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Id: 43c5da8fa182486990154b6f22539593 May 23 17:26:47.482859 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-AttachVolumeNegativeTest-200847774 May 23 17:26:47.482859 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Role: reader,member May 23 17:26:47.482859 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Roles: reader,member May 23 17:26:47.484434 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43c5da8fa182486990154b6f22539593"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/43c5da8fa182486990154b6f22539593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43c5da8fa182486990154b6f22539593"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_43c5da8fa182486990154b6f22539593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:26:47.484434 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-AttachVolumeNegativeTest-200847774 May 23 17:26:47.484434 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 43c5da8fa182486990154b6f22539593 May 23 17:26:47.484434 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-200847774 May 23 17:26:47.484434 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User: tempest-AttachVolumeNegativeTest-200847774-project May 23 17:26:47.484434 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default May 23 17:26:47.484434 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default May 23 17:26:47.484434 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Id: b4780bb497234a249b6d23afdab14370 May 23 17:26:47.484434 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-AttachVolumeNegativeTest-200847774-project May 23 17:26:47.484434 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: method: > May 23 17:26:47.484434 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: exception: Instance 95a14987-7a38-406c-b32b-08c1a601f883 could not be found. May 23 17:26:47.484434 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: action_args: {'id': '95a14987-7a38-406c-b32b-08c1a601f883'} May 23 17:26:47.485238 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:26:47.485238 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:26:47.485238 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:26:47.485238 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:26:47.485238 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:26:47.485238 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:26:47.485238 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:26:47.485238 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:26:47.485238 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:26:47.485238 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:26:47.485238 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95a14987-7a38-406c-b32b-08c1a601f883 could not be found. May 23 17:26:47.485238 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:26:47.485238 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:26:47.485238 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:26:47.485238 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:26:47.485238 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:26:47.485238 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:26:47.485238 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:26:47.485238 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:26:47.485238 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:26:47.486827 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:26:47.486827 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 17:26:47.486827 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 17:26:47.486827 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:26:47.486827 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:26:47.486827 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:26:47.486827 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:26:47.486827 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95a14987-7a38-406c-b32b-08c1a601f883 could not be found. May 23 17:26:47.486827 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:26:47.486827 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:26:47.486827 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:26:47.486827 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:26:47.486827 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:26:47.486827 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:26:47.486827 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:26:47.486827 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:26:47.486827 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95a14987-7a38-406c-b32b-08c1a601f883 could not be found. May 23 17:26:47.486827 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:26:47.488522 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-758300ac-c1d5-4111-9dff-36b86d8aacb5 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Returning 404 to user: Instance 95a14987-7a38-406c-b32b-08c1a601f883 could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:26:47.488522 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-758300ac-c1d5-4111-9dff-36b86d8aacb5 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883" status: 404 len: 111 microversion: 2.1 time: 0.036693 May 23 17:26:47.488522 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 429/871] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:26:47 2022] GET /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:26:47.494763 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e05fc868-f5fa-4a2b-ace9-2a224315ba46 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '.version_select at 0x7fd7a0429c10>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:47.514456 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-e05fc868-f5fa-4a2b-ace9-2a224315ba46 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1221795149" status: 202 len: 0 microversion: 2.1 time: 0.024422 May 23 17:26:47.515404 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 443/872] 10.222.0.46 () {58 vars in 1220 bytes} [Mon May 23 17:26:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1221795149 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 17:26:48.166107 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-562f9127-2246-47c7-9942-cb90a51e38ca tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:48.166583 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-562f9127-2246-47c7-9942-cb90a51e38ca tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 161b8434-8d45-4f38-b174-c2c2de66ec87] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:48.174474 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-562f9127-2246-47c7-9942-cb90a51e38ca tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:48.175099 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-562f9127-2246-47c7-9942-cb90a51e38ca tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:48.176255 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-562f9127-2246-47c7-9942-cb90a51e38ca tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:48.176853 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-562f9127-2246-47c7-9942-cb90a51e38ca tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:48.267356 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.objects.instance [None req-562f9127-2246-47c7-9942-cb90a51e38ca tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lazy-loading 'services' on Instance uuid 161b8434-8d45-4f38-b174-c2c2de66ec87 {{(pid=117909) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 17:26:48.353721 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-562f9127-2246-47c7-9942-cb90a51e38ca tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "DELETE /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87/os-volume_attachments/5d17d27c-b124-4e52-bbe0-68f258385938" status: 202 len: 0 microversion: 2.1 time: 0.190892 May 23 17:26:48.354670 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 430/873] 10.222.0.46 () {58 vars in 1415 bytes} [Mon May 23 17:26:48 2022] DELETE /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87/os-volume_attachments/5d17d27c-b124-4e52-bbe0-68f258385938 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 17:26:48.363344 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-73a11df5-f570-480b-8a57-b20749fd8921 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:48.364461 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-73a11df5-f570-480b-8a57-b20749fd8921 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 161b8434-8d45-4f38-b174-c2c2de66ec87] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:48.371851 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-73a11df5-f570-480b-8a57-b20749fd8921 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:48.372315 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-73a11df5-f570-480b-8a57-b20749fd8921 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:48.373111 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-73a11df5-f570-480b-8a57-b20749fd8921 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:48.373543 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-73a11df5-f570-480b-8a57-b20749fd8921 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:48.403946 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-73a11df5-f570-480b-8a57-b20749fd8921 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044559 May 23 17:26:48.404525 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 444/874] 10.222.0.46 () {58 vars in 1301 bytes} [Mon May 23 17:26:48 2022] GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:26:49.422033 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a3a39fff-c538-4e47-b2db-98aa0790f21e tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:49.423108 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a3a39fff-c538-4e47-b2db-98aa0790f21e tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 161b8434-8d45-4f38-b174-c2c2de66ec87] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:49.429573 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a3a39fff-c538-4e47-b2db-98aa0790f21e tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:49.430051 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a3a39fff-c538-4e47-b2db-98aa0790f21e tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:49.430979 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a3a39fff-c538-4e47-b2db-98aa0790f21e tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:49.431418 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a3a39fff-c538-4e47-b2db-98aa0790f21e tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:49.462642 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a3a39fff-c538-4e47-b2db-98aa0790f21e tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048246 May 23 17:26:49.463096 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 431/875] 10.222.0.46 () {58 vars in 1301 bytes} [Mon May 23 17:26:49 2022] GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 17:26:49.527970 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-6f875731-c3a8-4af2-8107-ad1ce4196cf1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:49.528497 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-6f875731-c3a8-4af2-8107-ad1ce4196cf1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 161b8434-8d45-4f38-b174-c2c2de66ec87] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:49.535547 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6f875731-c3a8-4af2-8107-ad1ce4196cf1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:49.535999 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6f875731-c3a8-4af2-8107-ad1ce4196cf1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:49.536824 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6f875731-c3a8-4af2-8107-ad1ce4196cf1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:49.537258 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6f875731-c3a8-4af2-8107-ad1ce4196cf1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:49.562369 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-6f875731-c3a8-4af2-8107-ad1ce4196cf1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 161b8434-8d45-4f38-b174-c2c2de66ec87] Going to try to terminate instance {{(pid=117910) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 17:26:49.643800 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-6f875731-c3a8-4af2-8107-ad1ce4196cf1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "DELETE /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87" status: 204 len: 0 microversion: 2.1 time: 0.119584 May 23 17:26:49.644394 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 445/876] 10.222.0.46 () {58 vars in 1238 bytes} [Mon May 23 17:26:49 2022] DELETE /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 17:26:49.652688 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-30940d55-ff3f-4211-b591-1fe8ad51366c tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:49.653318 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-30940d55-ff3f-4211-b591-1fe8ad51366c tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 161b8434-8d45-4f38-b174-c2c2de66ec87] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:49.659303 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-30940d55-ff3f-4211-b591-1fe8ad51366c tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:49.659754 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-30940d55-ff3f-4211-b591-1fe8ad51366c tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:49.660518 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-30940d55-ff3f-4211-b591-1fe8ad51366c tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:49.661005 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-30940d55-ff3f-4211-b591-1fe8ad51366c tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:49.796926 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-30940d55-ff3f-4211-b591-1fe8ad51366c tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:26:49.806069 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-30940d55-ff3f-4211-b591-1fe8ad51366c tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87" status: 200 len: 1681 microversion: 2.1 time: 0.156995 May 23 17:26:49.806758 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 432/877] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:26:49 2022] GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:26:50.824589 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-5fdd7e73-9681-45de-9dc3-89f2e8d330d7 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:50.825291 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-5fdd7e73-9681-45de-9dc3-89f2e8d330d7 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 161b8434-8d45-4f38-b174-c2c2de66ec87] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:50.832318 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5fdd7e73-9681-45de-9dc3-89f2e8d330d7 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:50.832803 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5fdd7e73-9681-45de-9dc3-89f2e8d330d7 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:50.833560 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5fdd7e73-9681-45de-9dc3-89f2e8d330d7 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:50.834008 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5fdd7e73-9681-45de-9dc3-89f2e8d330d7 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:50.838321 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:26:51.060283 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-5fdd7e73-9681-45de-9dc3-89f2e8d330d7 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:26:51.069414 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-cb2690d4-0f77-4de1-8c0d-51f16fadfca4 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:51.070498 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-cb2690d4-0f77-4de1-8c0d-51f16fadfca4 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:51.082731 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-5fdd7e73-9681-45de-9dc3-89f2e8d330d7 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87" status: 200 len: 1681 microversion: 2.1 time: 0.262396 May 23 17:26:51.083320 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 446/878] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:26:50 2022] GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87 => generated 1681 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:26:51.095315 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cb2690d4-0f77-4de1-8c0d-51f16fadfca4 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:51.095771 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cb2690d4-0f77-4de1-8c0d-51f16fadfca4 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:51.096617 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cb2690d4-0f77-4de1-8c0d-51f16fadfca4 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:51.098226 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-8fd3fec2-424f-4657-ab87-96b842f8107d req-6e309ac1-e339-41e7-a3e2-5d373a34b570 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449", "tag": "5b7000cf-6dcc-49e8-9708-84b48edff5e4"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:26:51.098474 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cb2690d4-0f77-4de1-8c0d-51f16fadfca4 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:51.103420 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:26:51.112142 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-8fd3fec2-424f-4657-ab87-96b842f8107d req-6e309ac1-e339-41e7-a3e2-5d373a34b570 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:51.113260 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-8fd3fec2-424f-4657-ab87-96b842f8107d req-6e309ac1-e339-41e7-a3e2-5d373a34b570 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:51.128652 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-cb2690d4-0f77-4de1-8c0d-51f16fadfca4 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449] Going to try to terminate instance {{(pid=117909) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 17:26:51.135677 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-8fd3fec2-424f-4657-ab87-96b842f8107d req-6e309ac1-e339-41e7-a3e2-5d373a34b570 service nova] Creating event network-changed:5b7000cf-6dcc-49e8-9708-84b48edff5e4 for instance a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449 on hv-cinder-84299 May 23 17:26:51.141706 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-8fd3fec2-424f-4657-ab87-96b842f8107d req-6e309ac1-e339-41e7-a3e2-5d373a34b570 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048028 May 23 17:26:51.142519 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 447/879] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:26:51.208041 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-cb2690d4-0f77-4de1-8c0d-51f16fadfca4 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449" status: 204 len: 0 microversion: 2.1 time: 0.142261 May 23 17:26:51.208956 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 433/880] 10.222.0.46 () {58 vars in 1238 bytes} [Mon May 23 17:26:51 2022] DELETE /compute/v2.1/servers/a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 17:26:51.218209 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-10621d28-272e-43a1-bc67-ac9cbaa31703 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:51.218923 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-10621d28-272e-43a1-bc67-ac9cbaa31703 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:51.225887 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-10621d28-272e-43a1-bc67-ac9cbaa31703 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:51.226710 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-10621d28-272e-43a1-bc67-ac9cbaa31703 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:51.227663 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-10621d28-272e-43a1-bc67-ac9cbaa31703 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:51.228263 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-10621d28-272e-43a1-bc67-ac9cbaa31703 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:51.363105 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-10621d28-272e-43a1-bc67-ac9cbaa31703 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:26:51.370978 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-10621d28-272e-43a1-bc67-ac9cbaa31703 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449" status: 200 len: 1574 microversion: 2.1 time: 0.157414 May 23 17:26:51.371560 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 448/881] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:26:51 2022] GET /compute/v2.1/servers/a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:26:52.109901 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ea924618-7ea2-49e7-91be-c1a8707eae13 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:52.110579 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ea924618-7ea2-49e7-91be-c1a8707eae13 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 161b8434-8d45-4f38-b174-c2c2de66ec87] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:52.120674 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ea924618-7ea2-49e7-91be-c1a8707eae13 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:52.121218 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ea924618-7ea2-49e7-91be-c1a8707eae13 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:52.122263 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ea924618-7ea2-49e7-91be-c1a8707eae13 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:52.122854 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ea924618-7ea2-49e7-91be-c1a8707eae13 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:52.256874 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ea924618-7ea2-49e7-91be-c1a8707eae13 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:26:52.265202 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ea924618-7ea2-49e7-91be-c1a8707eae13 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87" status: 200 len: 1681 microversion: 2.1 time: 0.162494 May 23 17:26:52.265785 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 434/882] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:26:52 2022] GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:26:52.389133 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-35b4401a-1476-4fdf-ba70-9d4ad62d40c1 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:52.389744 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-35b4401a-1476-4fdf-ba70-9d4ad62d40c1 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:52.398110 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-35b4401a-1476-4fdf-ba70-9d4ad62d40c1 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:52.398853 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-35b4401a-1476-4fdf-ba70-9d4ad62d40c1 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:52.399780 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-35b4401a-1476-4fdf-ba70-9d4ad62d40c1 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:52.400251 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-35b4401a-1476-4fdf-ba70-9d4ad62d40c1 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:52.540470 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-35b4401a-1476-4fdf-ba70-9d4ad62d40c1 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:26:52.548499 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-35b4401a-1476-4fdf-ba70-9d4ad62d40c1 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449" status: 200 len: 1574 microversion: 2.1 time: 0.163777 May 23 17:26:52.549119 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 449/883] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:26:52 2022] GET /compute/v2.1/servers/a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449 => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:26:53.282758 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8eb320be-6540-4200-bad4-2b7bf3839e0a tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:53.283363 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8eb320be-6540-4200-bad4-2b7bf3839e0a tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 161b8434-8d45-4f38-b174-c2c2de66ec87] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:53.290537 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8eb320be-6540-4200-bad4-2b7bf3839e0a tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:53.290983 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8eb320be-6540-4200-bad4-2b7bf3839e0a tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:53.291767 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8eb320be-6540-4200-bad4-2b7bf3839e0a tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:53.293049 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8eb320be-6540-4200-bad4-2b7bf3839e0a tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:53.375946 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8eb320be-6540-4200-bad4-2b7bf3839e0a tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:26:53.396624 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8eb320be-6540-4200-bad4-2b7bf3839e0a tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87" status: 200 len: 1613 microversion: 2.1 time: 0.115968 May 23 17:26:53.397410 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 435/884] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:26:53 2022] GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87 => generated 1613 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:26:53.400502 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-a7b3edc7-e571-4409-b82d-22b4e87a5094 req-5c438d2c-1e01-452f-ae28-01e5b4b55756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "161b8434-8d45-4f38-b174-c2c2de66ec87", "name": "network-vif-deleted", "tag": "5c5448fe-8b65-44a3-ac1f-8c9ca3dcf82b"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:26:53.410733 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-a7b3edc7-e571-4409-b82d-22b4e87a5094 req-5c438d2c-1e01-452f-ae28-01e5b4b55756 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:53.411507 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-a7b3edc7-e571-4409-b82d-22b4e87a5094 req-5c438d2c-1e01-452f-ae28-01e5b4b55756 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:53.447307 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-a7b3edc7-e571-4409-b82d-22b4e87a5094 req-5c438d2c-1e01-452f-ae28-01e5b4b55756 service nova] Creating event network-vif-deleted:5c5448fe-8b65-44a3-ac1f-8c9ca3dcf82b for instance 161b8434-8d45-4f38-b174-c2c2de66ec87 on hv-cinder-84299 May 23 17:26:53.458241 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-a7b3edc7-e571-4409-b82d-22b4e87a5094 req-5c438d2c-1e01-452f-ae28-01e5b4b55756 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061337 May 23 17:26:53.459031 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 450/885] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 17:26:53.565164 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9a017daf-d2cc-4302-b003-a09c55d81344 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:53.565787 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9a017daf-d2cc-4302-b003-a09c55d81344 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:53.577125 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9a017daf-d2cc-4302-b003-a09c55d81344 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:53.577587 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9a017daf-d2cc-4302-b003-a09c55d81344 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:53.578383 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9a017daf-d2cc-4302-b003-a09c55d81344 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:53.578823 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9a017daf-d2cc-4302-b003-a09c55d81344 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:53.724732 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-e7995625-b860-44ee-893c-76a162e5f599 req-106611fa-ef08-422f-ad32-7d8582644eaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449", "name": "network-vif-deleted", "tag": "5b7000cf-6dcc-49e8-9708-84b48edff5e4"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:26:53.727995 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9a017daf-d2cc-4302-b003-a09c55d81344 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:26:53.736407 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9a017daf-d2cc-4302-b003-a09c55d81344 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449" status: 200 len: 1389 microversion: 2.1 time: 0.175168 May 23 17:26:53.737272 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 436/886] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:26:53 2022] GET /compute/v2.1/servers/a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449 => generated 1389 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:26:53.740509 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-e7995625-b860-44ee-893c-76a162e5f599 req-106611fa-ef08-422f-ad32-7d8582644eaf service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:53.741110 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-e7995625-b860-44ee-893c-76a162e5f599 req-106611fa-ef08-422f-ad32-7d8582644eaf service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:53.752372 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-e7995625-b860-44ee-893c-76a162e5f599 req-106611fa-ef08-422f-ad32-7d8582644eaf service nova] Creating event network-vif-deleted:5b7000cf-6dcc-49e8-9708-84b48edff5e4 for instance a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449 on hv-cinder-84299 May 23 17:26:53.761226 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-e7995625-b860-44ee-893c-76a162e5f599 req-106611fa-ef08-422f-ad32-7d8582644eaf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040216 May 23 17:26:53.762665 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 451/887] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:26:54.414758 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-72e6c12b-bd39-439e-aec6-cc88dea646fc tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:54.415409 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-72e6c12b-bd39-439e-aec6-cc88dea646fc tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 161b8434-8d45-4f38-b174-c2c2de66ec87] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:54.422780 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-72e6c12b-bd39-439e-aec6-cc88dea646fc tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:54.423232 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-72e6c12b-bd39-439e-aec6-cc88dea646fc tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:54.424066 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-72e6c12b-bd39-439e-aec6-cc88dea646fc tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:54.424649 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-72e6c12b-bd39-439e-aec6-cc88dea646fc tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:54.440796 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-72e6c12b-bd39-439e-aec6-cc88dea646fc tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] HTTP exception thrown: Instance 161b8434-8d45-4f38-b174-c2c2de66ec87 could not be found. May 23 17:26:54.442484 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-72e6c12b-bd39-439e-aec6-cc88dea646fc tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Request method failure captured: May 23 17:26:54.442484 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: request: GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87 HTTP/1.1 May 23 17:26:54.442484 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept: application/json May 23 17:26:54.442484 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity May 23 17:26:54.442484 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Connection: close May 23 17:26:54.442484 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Length: 0 May 23 17:26:54.442484 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Type: application/json May 23 17:26:54.442484 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Host: 10.222.0.46 May 23 17:26:54.442484 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None May 23 17:26:54.442484 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.9 May 23 17:26:54.442484 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABii8NlLxi80dSOGWL-lavmFeqdu7SsvZyfTIUgOEBMGxHagzi4-1UBzzWbKQ8ofm4C3ey4lzhkyKgnXXkVv8I8JI8XYGl9o7m9yKgGHy9m_tm7J0ml_lU8wosqr4A40dh-VL78ZzvIVJ9JNStDlW1mMD3CLnYBqgsXfzf-XjoMWG-RrH8 May 23 17:26:54.442484 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Id: None May 23 17:26:54.442484 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Name: None May 23 17:26:54.442484 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed May 23 17:26:54.442484 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True May 23 17:26:54.442484 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default May 23 17:26:54.442484 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default May 23 17:26:54.442484 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Id: 43c5da8fa182486990154b6f22539593 May 23 17:26:54.442484 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-AttachVolumeNegativeTest-200847774 May 23 17:26:54.442484 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Role: reader,member May 23 17:26:54.442484 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Roles: reader,member May 23 17:26:54.444032 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43c5da8fa182486990154b6f22539593"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/43c5da8fa182486990154b6f22539593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43c5da8fa182486990154b6f22539593"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_43c5da8fa182486990154b6f22539593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:26:54.444032 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-AttachVolumeNegativeTest-200847774 May 23 17:26:54.444032 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 43c5da8fa182486990154b6f22539593 May 23 17:26:54.444032 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-200847774 May 23 17:26:54.444032 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User: tempest-AttachVolumeNegativeTest-200847774-project May 23 17:26:54.444032 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default May 23 17:26:54.444032 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default May 23 17:26:54.444032 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Id: b4780bb497234a249b6d23afdab14370 May 23 17:26:54.444032 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-AttachVolumeNegativeTest-200847774-project May 23 17:26:54.444032 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: method: > May 23 17:26:54.444032 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: exception: Instance 161b8434-8d45-4f38-b174-c2c2de66ec87 could not be found. May 23 17:26:54.444032 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: action_args: {'id': '161b8434-8d45-4f38-b174-c2c2de66ec87'} May 23 17:26:54.448254 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:26:54.448254 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:26:54.448254 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:26:54.448254 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:26:54.448254 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:26:54.448254 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:26:54.448254 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:26:54.448254 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:26:54.448254 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:26:54.448254 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:26:54.448254 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 161b8434-8d45-4f38-b174-c2c2de66ec87 could not be found. May 23 17:26:54.448254 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:26:54.448254 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:26:54.448254 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:26:54.448254 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:26:54.448254 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:26:54.448254 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:26:54.448254 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:26:54.448254 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:26:54.448254 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:26:54.449727 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:26:54.449727 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 17:26:54.449727 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 17:26:54.449727 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:26:54.449727 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:26:54.449727 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:26:54.449727 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:26:54.449727 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 161b8434-8d45-4f38-b174-c2c2de66ec87 could not be found. May 23 17:26:54.449727 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:26:54.449727 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:26:54.449727 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:26:54.449727 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:26:54.449727 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:26:54.449727 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:26:54.449727 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:26:54.449727 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:26:54.449727 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 161b8434-8d45-4f38-b174-c2c2de66ec87 could not be found. May 23 17:26:54.449727 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:26:54.451025 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-72e6c12b-bd39-439e-aec6-cc88dea646fc tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Returning 404 to user: Instance 161b8434-8d45-4f38-b174-c2c2de66ec87 could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:26:54.451025 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-72e6c12b-bd39-439e-aec6-cc88dea646fc tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87" status: 404 len: 111 microversion: 2.1 time: 0.033129 May 23 17:26:54.451025 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 437/888] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:26:54 2022] GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:26:54.454393 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-7d49ff47-0a4b-4cf3-96c7-7c5ad1db3b3b tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '.version_select at 0x7fd7a0654f70>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:54.482773 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-7d49ff47-0a4b-4cf3-96c7-7c5ad1db3b3b tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-180259544" status: 202 len: 0 microversion: 2.1 time: 0.033231 May 23 17:26:54.483379 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 452/889] 10.222.0.46 () {58 vars in 1217 bytes} [Mon May 23 17:26:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-180259544 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 17:26:54.754404 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9f6f5c3b-eb64-4419-a7d1-8c703f67a1e3 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:54.755030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9f6f5c3b-eb64-4419-a7d1-8c703f67a1e3 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:54.762008 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9f6f5c3b-eb64-4419-a7d1-8c703f67a1e3 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:54.762411 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9f6f5c3b-eb64-4419-a7d1-8c703f67a1e3 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:54.763422 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9f6f5c3b-eb64-4419-a7d1-8c703f67a1e3 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:54.763910 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9f6f5c3b-eb64-4419-a7d1-8c703f67a1e3 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:54.783545 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-9f6f5c3b-eb64-4419-a7d1-8c703f67a1e3 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] HTTP exception thrown: Instance a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449 could not be found. May 23 17:26:54.785146 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9f6f5c3b-eb64-4419-a7d1-8c703f67a1e3 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Request method failure captured: May 23 17:26:54.785146 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: request: GET /compute/v2.1/servers/a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449 HTTP/1.1 May 23 17:26:54.785146 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept: application/json May 23 17:26:54.785146 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity May 23 17:26:54.785146 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Connection: close May 23 17:26:54.785146 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Length: 0 May 23 17:26:54.785146 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Type: application/json May 23 17:26:54.785146 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Host: 10.222.0.46 May 23 17:26:54.785146 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None May 23 17:26:54.785146 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.9 May 23 17:26:54.785146 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABii8IJ0xnlh991vdAkzlqZuR3jYW9VmNK_4Z5wbIDqB_PpITXEm6-e4APorfgZdZ3nHqu7BEGWFCgpbJBxpDfU9yTxsRmgCzw5QH9LZFFbCdWUTN5GY4dmIDiGdkWhgDqPtD8wYfsus7_VobeVwBHZmlnmU5iw2CFgkkMwvISPdBTRGO4 May 23 17:26:54.785146 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Id: None May 23 17:26:54.785146 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Name: None May 23 17:26:54.785146 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed May 23 17:26:54.785146 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True May 23 17:26:54.785146 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default May 23 17:26:54.785146 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default May 23 17:26:54.785146 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Id: df984bae4f4e4d01ac06870bee8a73bf May 23 17:26:54.785146 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-TestVolumeBootPattern-1482174366 May 23 17:26:54.785146 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Role: reader,member May 23 17:26:54.785146 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Roles: reader,member May 23 17:26:54.786914 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/df984bae4f4e4d01ac06870bee8a73bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/df984bae4f4e4d01ac06870bee8a73bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/df984bae4f4e4d01ac06870bee8a73bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_df984bae4f4e4d01ac06870bee8a73bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:26:54.786914 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-TestVolumeBootPattern-1482174366 May 23 17:26:54.786914 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Id: df984bae4f4e4d01ac06870bee8a73bf May 23 17:26:54.786914 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-TestVolumeBootPattern-1482174366 May 23 17:26:54.786914 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User: tempest-TestVolumeBootPattern-1482174366-project May 23 17:26:54.786914 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default May 23 17:26:54.786914 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default May 23 17:26:54.786914 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Id: dc9c9dd337834dea821cc4ea6ecc10a6 May 23 17:26:54.786914 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-TestVolumeBootPattern-1482174366-project May 23 17:26:54.786914 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: method: > May 23 17:26:54.786914 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: exception: Instance a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449 could not be found. May 23 17:26:54.786914 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: action_args: {'id': 'a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449'} May 23 17:26:54.788107 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:26:54.788107 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:26:54.788107 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:26:54.788107 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:26:54.788107 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:26:54.788107 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:26:54.788107 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:26:54.788107 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:26:54.788107 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:26:54.788107 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:26:54.788107 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449 could not be found. May 23 17:26:54.788107 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:26:54.788107 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:26:54.788107 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:26:54.788107 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:26:54.788107 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:26:54.788107 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:26:54.788107 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:26:54.788107 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:26:54.788107 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:26:54.789825 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:26:54.789825 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 17:26:54.789825 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 17:26:54.789825 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:26:54.789825 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:26:54.789825 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:26:54.789825 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:26:54.789825 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449 could not be found. May 23 17:26:54.789825 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:26:54.789825 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:26:54.789825 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:26:54.789825 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:26:54.789825 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:26:54.789825 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:26:54.789825 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:26:54.789825 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:26:54.789825 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449 could not be found. May 23 17:26:54.789825 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:26:54.793841 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9f6f5c3b-eb64-4419-a7d1-8c703f67a1e3 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Returning 404 to user: Instance a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449 could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:26:54.794929 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9f6f5c3b-eb64-4419-a7d1-8c703f67a1e3 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449" status: 404 len: 111 microversion: 2.1 time: 0.044504 May 23 17:26:54.799594 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 438/890] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:26:54 2022] GET /compute/v2.1/servers/a6c0f88f-7f5a-49b6-afd9-e2f1b1a97449 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:26:55.305891 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b9da4f93-0e77-416a-86b8-4b50cb042848 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Action: 'create', calling method: .version_select at 0x7fd7a03a7040>, body: {"keypair": {"name": "tempest-keypair-1033895600", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+ssq6S3eiTHVBcljR7crHxGtqDdlU2Hl4aaEJ/VZ3dMTWyVgmvOlzWYZrPJNItMACDwlNWyhoo8ITDIR1G0TFAISLJlt86UC/4ZAcK4fS20gL85x3K8MsGpQsrH5I9HA=="}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:26:55.320128 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-b9da4f93-0e77-416a-86b8-4b50cb042848 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Getting quotas for project 43c5da8fa182486990154b6f22539593. Resources: {'key_pairs'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 17:26:55.324231 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-b9da4f93-0e77-416a-86b8-4b50cb042848 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Getting quotas for user b4780bb497234a249b6d23afdab14370 and project 43c5da8fa182486990154b6f22539593. Resources: {'key_pairs'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 17:26:55.348114 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b9da4f93-0e77-416a-86b8-4b50cb042848 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046295 May 23 17:26:55.348719 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 453/891] 10.222.0.46 () {60 vars in 1158 bytes} [Mon May 23 17:26:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:26:56.635312 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a147c2f4-4a6d-4055-8641-c7bbbf0b35be tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-500163830", "imageRef": "99870172-61a4-4218-9407-6a6da3fb5c83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5796957f-d0fc-4cb4-b196-c5a4f17f1ba0"}], "security_groups": [{"name": "tempest-securitygroup--1922301991"}], "key_name": "tempest-keypair-1033895600", "user_data": "}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:26:56.642827 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:26:56.743548 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.network.neutron [None req-a147c2f4-4a6d-4055-8641-c7bbbf0b35be tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] validate_networks() for [('5796957f-d0fc-4cb4-b196-c5a4f17f1ba0', None, None, None, None, None)] {{(pid=117909) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 17:26:57.402267 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-a147c2f4-4a6d-4055-8641-c7bbbf0b35be tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Flavor limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 17:26:57.402747 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-a147c2f4-4a6d-4055-8641-c7bbbf0b35be tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Image limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 17:26:57.403258 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-a147c2f4-4a6d-4055-8641-c7bbbf0b35be tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Flavor pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 17:26:57.403719 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-a147c2f4-4a6d-4055-8641-c7bbbf0b35be tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Image pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 17:26:57.404131 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-a147c2f4-4a6d-4055-8641-c7bbbf0b35be tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 17:26:57.413456 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a147c2f4-4a6d-4055-8641-c7bbbf0b35be tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:57.413901 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a147c2f4-4a6d-4055-8641-c7bbbf0b35be tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:57.414696 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a147c2f4-4a6d-4055-8641-c7bbbf0b35be tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:57.415131 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a147c2f4-4a6d-4055-8641-c7bbbf0b35be tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:57.431807 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-a147c2f4-4a6d-4055-8641-c7bbbf0b35be tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Getting quotas for project 43c5da8fa182486990154b6f22539593. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 17:26:57.435747 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-a147c2f4-4a6d-4055-8641-c7bbbf0b35be tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Getting quotas for user b4780bb497234a249b6d23afdab14370 and project 43c5da8fa182486990154b6f22539593. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 17:26:57.446863 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a147c2f4-4a6d-4055-8641-c7bbbf0b35be tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Going to run 1 instances... {{(pid=117909) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 17:26:57.449171 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a147c2f4-4a6d-4055-8641-c7bbbf0b35be tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: ca5370ce-8356-449c-be5b-fb4c0afb4080] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99870172-61a4-4218-9407-6a6da3fb5c83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 17:26:57.496365 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a147c2f4-4a6d-4055-8641-c7bbbf0b35be tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.865306 May 23 17:26:57.497234 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 439/892] 10.222.0.46 () {60 vars in 1146 bytes} [Mon May 23 17:26:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 17:26:57.507756 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-8bdb3fcb-f73c-480f-8e04-dc27e647fe6d tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:57.508493 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-8bdb3fcb-f73c-480f-8e04-dc27e647fe6d tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: ca5370ce-8356-449c-be5b-fb4c0afb4080] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:57.511067 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=2,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:26:57.582363 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-8bdb3fcb-f73c-480f-8e04-dc27e647fe6d tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:26:57.589718 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-8bdb3fcb-f73c-480f-8e04-dc27e647fe6d tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080" status: 200 len: 1241 microversion: 2.1 time: 0.086468 May 23 17:26:57.599681 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 454/893] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:26:57 2022] GET /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080 => generated 1241 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:26:57.918226 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c568d5e9-78da-4665-a781-3ff7fbce6c25 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:57.918803 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c568d5e9-78da-4665-a781-3ff7fbce6c25 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:57.920876 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-89f1ef07-5060-47da-8f1e-17b05d71476d req-d1c680bc-bb8e-4a0c-a165-6a0b19513470 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b", "tag": "74f45bbf-1787-4f63-af3f-00e8870f4cb8"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:26:57.926781 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c568d5e9-78da-4665-a781-3ff7fbce6c25 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:57.927311 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c568d5e9-78da-4665-a781-3ff7fbce6c25 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:57.928437 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c568d5e9-78da-4665-a781-3ff7fbce6c25 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:57.929014 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c568d5e9-78da-4665-a781-3ff7fbce6c25 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:57.930565 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-89f1ef07-5060-47da-8f1e-17b05d71476d req-d1c680bc-bb8e-4a0c-a165-6a0b19513470 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:57.931471 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-89f1ef07-5060-47da-8f1e-17b05d71476d req-d1c680bc-bb8e-4a0c-a165-6a0b19513470 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:57.944338 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-89f1ef07-5060-47da-8f1e-17b05d71476d req-d1c680bc-bb8e-4a0c-a165-6a0b19513470 service nova] Creating event network-changed:74f45bbf-1787-4f63-af3f-00e8870f4cb8 for instance 2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b on hv-cinder-84299 May 23 17:26:57.949976 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-89f1ef07-5060-47da-8f1e-17b05d71476d req-d1c680bc-bb8e-4a0c-a165-6a0b19513470 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032680 May 23 17:26:57.951250 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 455/894] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:26:57.964659 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c568d5e9-78da-4665-a781-3ff7fbce6c25 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b] Going to try to terminate instance {{(pid=117909) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 17:26:58.086377 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c568d5e9-78da-4665-a781-3ff7fbce6c25 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b" status: 204 len: 0 microversion: 2.1 time: 0.171725 May 23 17:26:58.087767 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 440/895] 10.222.0.46 () {58 vars in 1238 bytes} [Mon May 23 17:26:57 2022] DELETE /compute/v2.1/servers/2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 17:26:58.098788 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-cc00d016-26e1-42cb-95e3-ed3263ac32a9 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:58.100031 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-cc00d016-26e1-42cb-95e3-ed3263ac32a9 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:58.106585 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cc00d016-26e1-42cb-95e3-ed3263ac32a9 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:58.107116 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cc00d016-26e1-42cb-95e3-ed3263ac32a9 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:58.108183 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cc00d016-26e1-42cb-95e3-ed3263ac32a9 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:58.108705 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cc00d016-26e1-42cb-95e3-ed3263ac32a9 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:58.254851 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-cc00d016-26e1-42cb-95e3-ed3263ac32a9 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:26:58.264010 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-cc00d016-26e1-42cb-95e3-ed3263ac32a9 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b" status: 200 len: 1575 microversion: 2.1 time: 0.171583 May 23 17:26:58.264560 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 456/896] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:26:58 2022] GET /compute/v2.1/servers/2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:26:58.608735 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e1546183-3d8a-4e88-a822-453ad3d56c44 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:58.609442 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e1546183-3d8a-4e88-a822-453ad3d56c44 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: ca5370ce-8356-449c-be5b-fb4c0afb4080] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:58.616772 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e1546183-3d8a-4e88-a822-453ad3d56c44 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:58.617220 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e1546183-3d8a-4e88-a822-453ad3d56c44 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:58.618016 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e1546183-3d8a-4e88-a822-453ad3d56c44 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:58.618442 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e1546183-3d8a-4e88-a822-453ad3d56c44 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:58.685630 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e1546183-3d8a-4e88-a822-453ad3d56c44 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:26:58.693217 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e1546183-3d8a-4e88-a822-453ad3d56c44 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080" status: 200 len: 1293 microversion: 2.1 time: 0.090023 May 23 17:26:58.693787 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 441/897] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:26:58 2022] GET /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080 => generated 1293 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:26:59.286295 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-7875b752-f2bd-4880-bf7b-be1ed1c0883f tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:59.287186 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-7875b752-f2bd-4880-bf7b-be1ed1c0883f tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:59.296744 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7875b752-f2bd-4880-bf7b-be1ed1c0883f tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:59.297193 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7875b752-f2bd-4880-bf7b-be1ed1c0883f tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:59.297959 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7875b752-f2bd-4880-bf7b-be1ed1c0883f tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:59.298388 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7875b752-f2bd-4880-bf7b-be1ed1c0883f tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:59.428434 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-7875b752-f2bd-4880-bf7b-be1ed1c0883f tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:26:59.436143 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-7875b752-f2bd-4880-bf7b-be1ed1c0883f tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b" status: 200 len: 1575 microversion: 2.1 time: 0.155592 May 23 17:26:59.436996 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 457/898] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:26:59 2022] GET /compute/v2.1/servers/2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:26:59.715745 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9bf66fd6-1d82-4b78-b5cf-531d5daa05c0 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:26:59.716950 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9bf66fd6-1d82-4b78-b5cf-531d5daa05c0 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: ca5370ce-8356-449c-be5b-fb4c0afb4080] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:26:59.725187 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9bf66fd6-1d82-4b78-b5cf-531d5daa05c0 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:59.725632 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9bf66fd6-1d82-4b78-b5cf-531d5daa05c0 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:59.726389 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9bf66fd6-1d82-4b78-b5cf-531d5daa05c0 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:26:59.726823 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9bf66fd6-1d82-4b78-b5cf-531d5daa05c0 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:26:59.835786 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9bf66fd6-1d82-4b78-b5cf-531d5daa05c0 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:26:59.850704 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9bf66fd6-1d82-4b78-b5cf-531d5daa05c0 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080" status: 200 len: 1301 microversion: 2.1 time: 0.141819 May 23 17:26:59.858179 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 442/899] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:26:59 2022] GET /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080 => generated 1301 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:27:00.355183 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-b3de6845-56aa-4ed1-ad37-ae8dac0d2baa req-8d5d6bc8-9085-47cb-ab61-0e0dd49546c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b", "name": "network-vif-deleted", "tag": "74f45bbf-1787-4f63-af3f-00e8870f4cb8"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:27:00.363950 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-b3de6845-56aa-4ed1-ad37-ae8dac0d2baa req-8d5d6bc8-9085-47cb-ab61-0e0dd49546c7 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:00.364698 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-b3de6845-56aa-4ed1-ad37-ae8dac0d2baa req-8d5d6bc8-9085-47cb-ab61-0e0dd49546c7 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:00.377053 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-b3de6845-56aa-4ed1-ad37-ae8dac0d2baa req-8d5d6bc8-9085-47cb-ab61-0e0dd49546c7 service nova] Creating event network-vif-deleted:74f45bbf-1787-4f63-af3f-00e8870f4cb8 for instance 2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b on hv-cinder-84299 May 23 17:27:00.382238 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-b3de6845-56aa-4ed1-ad37-ae8dac0d2baa req-8d5d6bc8-9085-47cb-ab61-0e0dd49546c7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030787 May 23 17:27:00.383040 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 458/900] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 17:27:00.454824 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-073d81a8-ef58-49c4-ab1a-380c80cb2d29 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:27:00.455696 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-073d81a8-ef58-49c4-ab1a-380c80cb2d29 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:27:00.462326 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-073d81a8-ef58-49c4-ab1a-380c80cb2d29 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:00.462905 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-073d81a8-ef58-49c4-ab1a-380c80cb2d29 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:00.463764 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-073d81a8-ef58-49c4-ab1a-380c80cb2d29 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:00.464262 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-073d81a8-ef58-49c4-ab1a-380c80cb2d29 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:00.538559 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-073d81a8-ef58-49c4-ab1a-380c80cb2d29 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9c9dd337834dea821cc4ea6ecc10a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df984bae4f4e4d01ac06870bee8a73bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:27:00.553726 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-073d81a8-ef58-49c4-ab1a-380c80cb2d29 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b" status: 200 len: 1225 microversion: 2.1 time: 0.103732 May 23 17:27:00.554820 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 443/901] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:27:00 2022] GET /compute/v2.1/servers/2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:27:00.869010 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-90ebd974-2cb8-4da9-8765-be298063ca28 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:27:00.869696 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-90ebd974-2cb8-4da9-8765-be298063ca28 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: ca5370ce-8356-449c-be5b-fb4c0afb4080] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:27:00.876589 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-90ebd974-2cb8-4da9-8765-be298063ca28 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:00.877162 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-90ebd974-2cb8-4da9-8765-be298063ca28 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:00.877938 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-90ebd974-2cb8-4da9-8765-be298063ca28 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:00.878376 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-90ebd974-2cb8-4da9-8765-be298063ca28 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:01.079284 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-90ebd974-2cb8-4da9-8765-be298063ca28 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:27:01.086952 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-90ebd974-2cb8-4da9-8765-be298063ca28 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080" status: 200 len: 1367 microversion: 2.1 time: 0.223191 May 23 17:27:01.087583 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 459/902] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:27:00 2022] GET /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:27:01.338808 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-4b759e7b-6304-41e2-9d2c-c66f39931e18 req-49ed0002-87db-421c-b51c-5cee98909288 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca5370ce-8356-449c-be5b-fb4c0afb4080", "tag": "ed7d2ca4-8fe4-4153-82f8-b5fa35faeb70"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:27:01.354880 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-4b759e7b-6304-41e2-9d2c-c66f39931e18 req-49ed0002-87db-421c-b51c-5cee98909288 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:01.355617 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-4b759e7b-6304-41e2-9d2c-c66f39931e18 req-49ed0002-87db-421c-b51c-5cee98909288 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:01.369207 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-4b759e7b-6304-41e2-9d2c-c66f39931e18 req-49ed0002-87db-421c-b51c-5cee98909288 service nova] Creating event network-changed:ed7d2ca4-8fe4-4153-82f8-b5fa35faeb70 for instance ca5370ce-8356-449c-be5b-fb4c0afb4080 on hv-cinder-84299 May 23 17:27:01.374781 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-4b759e7b-6304-41e2-9d2c-c66f39931e18 req-49ed0002-87db-421c-b51c-5cee98909288 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043778 May 23 17:27:01.375504 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 444/903] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:27:01.574826 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-f39fc717-bbe6-4e56-aa22-08eb84116f2e tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:27:01.575470 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-f39fc717-bbe6-4e56-aa22-08eb84116f2e tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:27:01.582470 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f39fc717-bbe6-4e56-aa22-08eb84116f2e tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:01.582916 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f39fc717-bbe6-4e56-aa22-08eb84116f2e tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:01.583691 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f39fc717-bbe6-4e56-aa22-08eb84116f2e tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:01.584127 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f39fc717-bbe6-4e56-aa22-08eb84116f2e tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:01.599198 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-f39fc717-bbe6-4e56-aa22-08eb84116f2e tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] HTTP exception thrown: Instance 2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b could not be found. May 23 17:27:01.600939 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-f39fc717-bbe6-4e56-aa22-08eb84116f2e tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Request method failure captured: May 23 17:27:01.600939 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: request: GET /compute/v2.1/servers/2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b HTTP/1.1 May 23 17:27:01.600939 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept: application/json May 23 17:27:01.600939 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity May 23 17:27:01.600939 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Connection: close May 23 17:27:01.600939 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Length: 0 May 23 17:27:01.600939 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Type: application/json May 23 17:27:01.600939 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Host: 10.222.0.46 May 23 17:27:01.600939 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None May 23 17:27:01.600939 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.9 May 23 17:27:01.600939 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABii8IJ0xnlh991vdAkzlqZuR3jYW9VmNK_4Z5wbIDqB_PpITXEm6-e4APorfgZdZ3nHqu7BEGWFCgpbJBxpDfU9yTxsRmgCzw5QH9LZFFbCdWUTN5GY4dmIDiGdkWhgDqPtD8wYfsus7_VobeVwBHZmlnmU5iw2CFgkkMwvISPdBTRGO4 May 23 17:27:01.600939 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Id: None May 23 17:27:01.600939 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Name: None May 23 17:27:01.600939 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed May 23 17:27:01.600939 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True May 23 17:27:01.600939 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default May 23 17:27:01.600939 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default May 23 17:27:01.600939 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Id: df984bae4f4e4d01ac06870bee8a73bf May 23 17:27:01.600939 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-TestVolumeBootPattern-1482174366 May 23 17:27:01.600939 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Role: reader,member May 23 17:27:01.600939 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Roles: reader,member May 23 17:27:01.602307 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/df984bae4f4e4d01ac06870bee8a73bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/df984bae4f4e4d01ac06870bee8a73bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/df984bae4f4e4d01ac06870bee8a73bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_df984bae4f4e4d01ac06870bee8a73bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:27:01.602307 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-TestVolumeBootPattern-1482174366 May 23 17:27:01.602307 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Id: df984bae4f4e4d01ac06870bee8a73bf May 23 17:27:01.602307 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-TestVolumeBootPattern-1482174366 May 23 17:27:01.602307 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User: tempest-TestVolumeBootPattern-1482174366-project May 23 17:27:01.602307 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default May 23 17:27:01.602307 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default May 23 17:27:01.602307 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Id: dc9c9dd337834dea821cc4ea6ecc10a6 May 23 17:27:01.602307 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-TestVolumeBootPattern-1482174366-project May 23 17:27:01.602307 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: method: > May 23 17:27:01.602307 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: exception: Instance 2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b could not be found. May 23 17:27:01.602307 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: action_args: {'id': '2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b'} May 23 17:27:01.603062 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:27:01.603062 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:27:01.603062 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:27:01.603062 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:27:01.603062 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:27:01.603062 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:27:01.603062 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:27:01.603062 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:27:01.603062 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:27:01.603062 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:27:01.603062 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b could not be found. May 23 17:27:01.603062 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:27:01.603062 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:27:01.603062 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:27:01.603062 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:27:01.603062 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:27:01.603062 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:27:01.603062 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:27:01.603062 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:27:01.603062 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:27:01.604304 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:27:01.604304 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 17:27:01.604304 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 17:27:01.604304 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:27:01.604304 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:27:01.604304 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:27:01.604304 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:27:01.604304 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b could not be found. May 23 17:27:01.604304 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:27:01.604304 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:27:01.604304 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:27:01.604304 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:27:01.604304 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:27:01.604304 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:27:01.604304 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:27:01.604304 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:27:01.604304 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b could not be found. May 23 17:27:01.604304 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:27:01.605453 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-f39fc717-bbe6-4e56-aa22-08eb84116f2e tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Returning 404 to user: Instance 2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:27:01.605453 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-f39fc717-bbe6-4e56-aa22-08eb84116f2e tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b" status: 404 len: 111 microversion: 2.1 time: 0.033750 May 23 17:27:01.605453 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 460/904] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:27:01 2022] GET /compute/v2.1/servers/2c9d5b0f-04a0-4c8b-8572-dc5d0a34e79b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:27:02.051030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4cdafc0e-7a9d-45c6-8459-1806e6769f55 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:27:02.051622 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4cdafc0e-7a9d-45c6-8459-1806e6769f55 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2391a78f-53ee-4e0f-b59f-5978e3ee93a0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:27:02.058172 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4cdafc0e-7a9d-45c6-8459-1806e6769f55 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:02.058623 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4cdafc0e-7a9d-45c6-8459-1806e6769f55 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:02.059397 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4cdafc0e-7a9d-45c6-8459-1806e6769f55 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:02.059842 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4cdafc0e-7a9d-45c6-8459-1806e6769f55 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:02.074534 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-4cdafc0e-7a9d-45c6-8459-1806e6769f55 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] HTTP exception thrown: Instance 2391a78f-53ee-4e0f-b59f-5978e3ee93a0 could not be found. May 23 17:27:02.076162 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4cdafc0e-7a9d-45c6-8459-1806e6769f55 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Request method failure captured: May 23 17:27:02.076162 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: request: DELETE /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0 HTTP/1.1 May 23 17:27:02.076162 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept: application/json May 23 17:27:02.076162 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity May 23 17:27:02.076162 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Connection: close May 23 17:27:02.076162 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Length: 0 May 23 17:27:02.076162 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Type: application/json May 23 17:27:02.076162 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Host: 10.222.0.46 May 23 17:27:02.076162 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None May 23 17:27:02.076162 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.9 May 23 17:27:02.076162 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABii8IJ0xnlh991vdAkzlqZuR3jYW9VmNK_4Z5wbIDqB_PpITXEm6-e4APorfgZdZ3nHqu7BEGWFCgpbJBxpDfU9yTxsRmgCzw5QH9LZFFbCdWUTN5GY4dmIDiGdkWhgDqPtD8wYfsus7_VobeVwBHZmlnmU5iw2CFgkkMwvISPdBTRGO4 May 23 17:27:02.076162 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Id: None May 23 17:27:02.076162 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Name: None May 23 17:27:02.076162 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed May 23 17:27:02.076162 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True May 23 17:27:02.076162 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default May 23 17:27:02.076162 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default May 23 17:27:02.076162 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Id: df984bae4f4e4d01ac06870bee8a73bf May 23 17:27:02.076162 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-TestVolumeBootPattern-1482174366 May 23 17:27:02.076162 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Role: reader,member May 23 17:27:02.076162 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Roles: reader,member May 23 17:27:02.077855 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/df984bae4f4e4d01ac06870bee8a73bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/df984bae4f4e4d01ac06870bee8a73bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/df984bae4f4e4d01ac06870bee8a73bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_df984bae4f4e4d01ac06870bee8a73bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:27:02.077855 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-TestVolumeBootPattern-1482174366 May 23 17:27:02.077855 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Id: df984bae4f4e4d01ac06870bee8a73bf May 23 17:27:02.077855 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-TestVolumeBootPattern-1482174366 May 23 17:27:02.077855 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User: tempest-TestVolumeBootPattern-1482174366-project May 23 17:27:02.077855 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default May 23 17:27:02.077855 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default May 23 17:27:02.077855 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Id: dc9c9dd337834dea821cc4ea6ecc10a6 May 23 17:27:02.077855 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-TestVolumeBootPattern-1482174366-project May 23 17:27:02.077855 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: method: > May 23 17:27:02.077855 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: exception: Instance 2391a78f-53ee-4e0f-b59f-5978e3ee93a0 could not be found. May 23 17:27:02.077855 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: action_args: {'id': '2391a78f-53ee-4e0f-b59f-5978e3ee93a0'} May 23 17:27:02.078738 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:27:02.078738 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:27:02.078738 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:27:02.078738 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:27:02.078738 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:27:02.078738 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:27:02.078738 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:27:02.078738 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:27:02.078738 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:27:02.078738 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:27:02.078738 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2391a78f-53ee-4e0f-b59f-5978e3ee93a0 could not be found. May 23 17:27:02.078738 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:27:02.078738 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:27:02.078738 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:27:02.078738 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:27:02.078738 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:27:02.078738 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:27:02.078738 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:27:02.078738 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:27:02.078738 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:27:02.080257 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:27:02.080257 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 17:27:02.080257 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 17:27:02.080257 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 17:27:02.080257 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 17:27:02.080257 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:27:02.080257 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:27:02.080257 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:27:02.080257 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:27:02.080257 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2391a78f-53ee-4e0f-b59f-5978e3ee93a0 could not be found. May 23 17:27:02.080257 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:27:02.080257 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:27:02.080257 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:27:02.080257 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:27:02.080257 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:27:02.080257 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:27:02.080257 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:27:02.080257 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:27:02.080257 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2391a78f-53ee-4e0f-b59f-5978e3ee93a0 could not be found. May 23 17:27:02.080257 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:27:02.081752 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4cdafc0e-7a9d-45c6-8459-1806e6769f55 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Returning 404 to user: Instance 2391a78f-53ee-4e0f-b59f-5978e3ee93a0 could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:27:02.081752 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4cdafc0e-7a9d-45c6-8459-1806e6769f55 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0" status: 404 len: 111 microversion: 2.1 time: 0.031019 May 23 17:27:02.081752 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 445/905] 10.222.0.46 () {58 vars in 1238 bytes} [Mon May 23 17:27:02 2022] DELETE /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:27:02.086270 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e8952ebd-21fc-4ea0-a115-535c5f6aa3d0 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:27:02.086934 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-e8952ebd-21fc-4ea0-a115-535c5f6aa3d0 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] [instance: 2391a78f-53ee-4e0f-b59f-5978e3ee93a0] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:27:02.093381 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e8952ebd-21fc-4ea0-a115-535c5f6aa3d0 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:02.093830 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e8952ebd-21fc-4ea0-a115-535c5f6aa3d0 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:02.094597 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e8952ebd-21fc-4ea0-a115-535c5f6aa3d0 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:02.095023 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e8952ebd-21fc-4ea0-a115-535c5f6aa3d0 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:02.104312 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d5f43030-0368-4944-b10d-b152d43984f9 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:27:02.105038 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d5f43030-0368-4944-b10d-b152d43984f9 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: ca5370ce-8356-449c-be5b-fb4c0afb4080] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:27:02.108801 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-e8952ebd-21fc-4ea0-a115-535c5f6aa3d0 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] HTTP exception thrown: Instance 2391a78f-53ee-4e0f-b59f-5978e3ee93a0 could not be found. May 23 17:27:02.110349 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e8952ebd-21fc-4ea0-a115-535c5f6aa3d0 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Request method failure captured: May 23 17:27:02.110349 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: request: GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0 HTTP/1.1 May 23 17:27:02.110349 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept: application/json May 23 17:27:02.110349 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity May 23 17:27:02.110349 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Connection: close May 23 17:27:02.110349 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Length: 0 May 23 17:27:02.110349 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Type: application/json May 23 17:27:02.110349 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Host: 10.222.0.46 May 23 17:27:02.110349 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None May 23 17:27:02.110349 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.9 May 23 17:27:02.110349 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABii8IJ0xnlh991vdAkzlqZuR3jYW9VmNK_4Z5wbIDqB_PpITXEm6-e4APorfgZdZ3nHqu7BEGWFCgpbJBxpDfU9yTxsRmgCzw5QH9LZFFbCdWUTN5GY4dmIDiGdkWhgDqPtD8wYfsus7_VobeVwBHZmlnmU5iw2CFgkkMwvISPdBTRGO4 May 23 17:27:02.110349 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Id: None May 23 17:27:02.110349 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Name: None May 23 17:27:02.110349 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed May 23 17:27:02.110349 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True May 23 17:27:02.110349 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default May 23 17:27:02.110349 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default May 23 17:27:02.110349 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Id: df984bae4f4e4d01ac06870bee8a73bf May 23 17:27:02.110349 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-TestVolumeBootPattern-1482174366 May 23 17:27:02.110349 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Role: reader,member May 23 17:27:02.110349 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Roles: reader,member May 23 17:27:02.111780 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/df984bae4f4e4d01ac06870bee8a73bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/df984bae4f4e4d01ac06870bee8a73bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/df984bae4f4e4d01ac06870bee8a73bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_df984bae4f4e4d01ac06870bee8a73bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:27:02.111780 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-TestVolumeBootPattern-1482174366 May 23 17:27:02.111780 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Id: df984bae4f4e4d01ac06870bee8a73bf May 23 17:27:02.111780 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-TestVolumeBootPattern-1482174366 May 23 17:27:02.111780 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User: tempest-TestVolumeBootPattern-1482174366-project May 23 17:27:02.111780 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default May 23 17:27:02.111780 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default May 23 17:27:02.111780 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Id: dc9c9dd337834dea821cc4ea6ecc10a6 May 23 17:27:02.111780 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-TestVolumeBootPattern-1482174366-project May 23 17:27:02.111780 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: method: > May 23 17:27:02.111780 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: exception: Instance 2391a78f-53ee-4e0f-b59f-5978e3ee93a0 could not be found. May 23 17:27:02.111780 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: action_args: {'id': '2391a78f-53ee-4e0f-b59f-5978e3ee93a0'} May 23 17:27:02.112731 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:27:02.112731 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:27:02.112731 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:27:02.112731 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:27:02.112731 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:27:02.112731 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:27:02.112731 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:27:02.112731 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:27:02.112731 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:27:02.112731 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:27:02.112731 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2391a78f-53ee-4e0f-b59f-5978e3ee93a0 could not be found. May 23 17:27:02.112731 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:27:02.112731 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:27:02.112731 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:27:02.112731 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:27:02.112731 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:27:02.112731 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:27:02.112731 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:27:02.112731 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:27:02.112731 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:27:02.114157 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:27:02.114157 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 17:27:02.114157 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 17:27:02.114157 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:27:02.114157 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:27:02.114157 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:27:02.114157 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:27:02.114157 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2391a78f-53ee-4e0f-b59f-5978e3ee93a0 could not be found. May 23 17:27:02.114157 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:27:02.114157 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:27:02.114157 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:27:02.114157 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:27:02.114157 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:27:02.114157 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:27:02.114157 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:27:02.114157 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:27:02.114157 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2391a78f-53ee-4e0f-b59f-5978e3ee93a0 could not be found. May 23 17:27:02.114157 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:27:02.115532 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e8952ebd-21fc-4ea0-a115-535c5f6aa3d0 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Returning 404 to user: Instance 2391a78f-53ee-4e0f-b59f-5978e3ee93a0 could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:27:02.115620 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d5f43030-0368-4944-b10d-b152d43984f9 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:02.115620 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d5f43030-0368-4944-b10d-b152d43984f9 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:02.115819 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-e8952ebd-21fc-4ea0-a115-535c5f6aa3d0 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0" status: 404 len: 111 microversion: 2.1 time: 0.029372 May 23 17:27:02.115819 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 461/906] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:27:02 2022] GET /compute/v2.1/servers/2391a78f-53ee-4e0f-b59f-5978e3ee93a0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:27:02.115996 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d5f43030-0368-4944-b10d-b152d43984f9 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:02.115996 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d5f43030-0368-4944-b10d-b152d43984f9 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:02.248470 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d5f43030-0368-4944-b10d-b152d43984f9 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:27:02.255999 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d5f43030-0368-4944-b10d-b152d43984f9 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080" status: 200 len: 1367 microversion: 2.1 time: 0.155589 May 23 17:27:02.256568 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 446/907] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:27:02 2022] GET /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:27:03.273523 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c9acb0cd-a0d6-4d19-b45e-be9675971025 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:27:03.274237 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c9acb0cd-a0d6-4d19-b45e-be9675971025 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: ca5370ce-8356-449c-be5b-fb4c0afb4080] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:27:03.281597 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c9acb0cd-a0d6-4d19-b45e-be9675971025 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:03.282050 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c9acb0cd-a0d6-4d19-b45e-be9675971025 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:03.282825 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c9acb0cd-a0d6-4d19-b45e-be9675971025 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:03.283261 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c9acb0cd-a0d6-4d19-b45e-be9675971025 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:03.456723 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-c9acb0cd-a0d6-4d19-b45e-be9675971025 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:27:03.464623 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c9acb0cd-a0d6-4d19-b45e-be9675971025 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080" status: 200 len: 1367 microversion: 2.1 time: 0.194958 May 23 17:27:03.465195 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 462/908] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:27:03 2022] GET /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080 => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:27:03.486619 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5043fafe-f0a6-4684-bf7f-d64d48bc7ca4 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] Calling method '.version_select at 0x7fd793c73820>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:27:03.505642 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5043fafe-f0a6-4684-bf7f-d64d48bc7ca4 tempest-TestVolumeBootPattern-1482174366 tempest-TestVolumeBootPattern-1482174366-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-423638123" status: 202 len: 0 microversion: 2.1 time: 0.022875 May 23 17:27:03.506233 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 447/909] 10.222.0.46 () {58 vars in 1259 bytes} [Mon May 23 17:27:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-423638123 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 17:27:04.483239 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-726706cb-bd0d-4872-9f69-c82692755799 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:27:04.484043 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-726706cb-bd0d-4872-9f69-c82692755799 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: ca5370ce-8356-449c-be5b-fb4c0afb4080] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:27:04.494946 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-726706cb-bd0d-4872-9f69-c82692755799 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:04.495472 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-726706cb-bd0d-4872-9f69-c82692755799 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:04.496198 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-726706cb-bd0d-4872-9f69-c82692755799 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:04.497073 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-726706cb-bd0d-4872-9f69-c82692755799 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:04.633864 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-726706cb-bd0d-4872-9f69-c82692755799 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:27:04.642342 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-726706cb-bd0d-4872-9f69-c82692755799 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080" status: 200 len: 1367 microversion: 2.1 time: 0.164073 May 23 17:27:04.642912 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 463/910] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:27:04 2022] GET /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:27:05.660346 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c1c82964-c94c-4ae5-b6a1-35e10ceeca9b tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:27:05.661691 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c1c82964-c94c-4ae5-b6a1-35e10ceeca9b tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: ca5370ce-8356-449c-be5b-fb4c0afb4080] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:27:05.668074 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c1c82964-c94c-4ae5-b6a1-35e10ceeca9b tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:05.668530 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c1c82964-c94c-4ae5-b6a1-35e10ceeca9b tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:05.669346 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c1c82964-c94c-4ae5-b6a1-35e10ceeca9b tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:05.669773 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c1c82964-c94c-4ae5-b6a1-35e10ceeca9b tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:06.012236 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c1c82964-c94c-4ae5-b6a1-35e10ceeca9b tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:27:06.019758 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c1c82964-c94c-4ae5-b6a1-35e10ceeca9b tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080" status: 200 len: 1367 microversion: 2.1 time: 0.364151 May 23 17:27:06.020336 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 448/911] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:27:05 2022] GET /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080 => generated 1367 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:27:06.197961 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-4258c91e-3fb7-479a-aadc-e0dc2ecea05d req-04ae30ec-c86e-4faf-9f5f-8ce32edeed95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca5370ce-8356-449c-be5b-fb4c0afb4080", "name": "network-vif-plugged", "status": "completed", "tag": "ed7d2ca4-8fe4-4153-82f8-b5fa35faeb70"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:27:06.215656 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-4258c91e-3fb7-479a-aadc-e0dc2ecea05d req-04ae30ec-c86e-4faf-9f5f-8ce32edeed95 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:06.216038 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-4258c91e-3fb7-479a-aadc-e0dc2ecea05d req-04ae30ec-c86e-4faf-9f5f-8ce32edeed95 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:06.242271 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-4258c91e-3fb7-479a-aadc-e0dc2ecea05d req-04ae30ec-c86e-4faf-9f5f-8ce32edeed95 service nova] Creating event network-vif-plugged:ed7d2ca4-8fe4-4153-82f8-b5fa35faeb70 for instance ca5370ce-8356-449c-be5b-fb4c0afb4080 on hv-cinder-84299 May 23 17:27:06.257395 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-4258c91e-3fb7-479a-aadc-e0dc2ecea05d req-04ae30ec-c86e-4faf-9f5f-8ce32edeed95 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066919 May 23 17:27:06.266781 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 464/912] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:27:07.036385 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-bfdfb696-1b8c-4d34-921e-a53ddbe6522c tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:27:07.037035 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-bfdfb696-1b8c-4d34-921e-a53ddbe6522c tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: ca5370ce-8356-449c-be5b-fb4c0afb4080] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:27:07.043628 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bfdfb696-1b8c-4d34-921e-a53ddbe6522c tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:07.044078 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bfdfb696-1b8c-4d34-921e-a53ddbe6522c tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:07.044888 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bfdfb696-1b8c-4d34-921e-a53ddbe6522c tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:07.045364 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bfdfb696-1b8c-4d34-921e-a53ddbe6522c tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:07.191789 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-bfdfb696-1b8c-4d34-921e-a53ddbe6522c tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:27:07.199569 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-bfdfb696-1b8c-4d34-921e-a53ddbe6522c tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080" status: 200 len: 1367 microversion: 2.1 time: 0.167146 May 23 17:27:07.200151 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 449/913] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:27:07 2022] GET /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:27:08.216649 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-7b089a0c-13dd-4315-80de-f95df67c18f2 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:27:08.217536 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-7b089a0c-13dd-4315-80de-f95df67c18f2 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: ca5370ce-8356-449c-be5b-fb4c0afb4080] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:27:08.220009 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=6 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:27:08.225676 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7b089a0c-13dd-4315-80de-f95df67c18f2 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:08.226129 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7b089a0c-13dd-4315-80de-f95df67c18f2 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:08.226908 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7b089a0c-13dd-4315-80de-f95df67c18f2 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:08.227361 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7b089a0c-13dd-4315-80de-f95df67c18f2 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:08.475020 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-7b089a0c-13dd-4315-80de-f95df67c18f2 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:27:08.485966 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-7b089a0c-13dd-4315-80de-f95df67c18f2 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080" status: 200 len: 1558 microversion: 2.1 time: 0.273493 May 23 17:27:08.486979 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 465/914] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:27:08 2022] GET /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080 => generated 1558 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:27:08.503228 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ad779fdc-f7b7-41b0-a693-847f61a34eca tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:27:08.503793 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ad779fdc-f7b7-41b0-a693-847f61a34eca tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: ca5370ce-8356-449c-be5b-fb4c0afb4080] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:27:08.506838 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=2 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:27:08.507709 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=6 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:27:08.513528 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ad779fdc-f7b7-41b0-a693-847f61a34eca tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:08.514156 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ad779fdc-f7b7-41b0-a693-847f61a34eca tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:08.514998 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ad779fdc-f7b7-41b0-a693-847f61a34eca tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:08.515496 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ad779fdc-f7b7-41b0-a693-847f61a34eca tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:08.887784 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ad779fdc-f7b7-41b0-a693-847f61a34eca tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.388374 May 23 17:27:08.888348 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 450/915] 10.222.0.46 () {58 vars in 1274 bytes} [Mon May 23 17:27:08 2022] GET /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080/os-interface => generated 285 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:27:10.141383 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-1c2d93a8-3767-4c50-b543-87a0249f6a3c req-ef2f209d-24bb-4aaa-b751-42796da7008a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca5370ce-8356-449c-be5b-fb4c0afb4080", "tag": "ed7d2ca4-8fe4-4153-82f8-b5fa35faeb70"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:27:10.150667 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-1c2d93a8-3767-4c50-b543-87a0249f6a3c req-ef2f209d-24bb-4aaa-b751-42796da7008a service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:10.151200 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-1c2d93a8-3767-4c50-b543-87a0249f6a3c req-ef2f209d-24bb-4aaa-b751-42796da7008a service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:10.162477 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-1c2d93a8-3767-4c50-b543-87a0249f6a3c req-ef2f209d-24bb-4aaa-b751-42796da7008a service nova] Creating event network-changed:ed7d2ca4-8fe4-4153-82f8-b5fa35faeb70 for instance ca5370ce-8356-449c-be5b-fb4c0afb4080 on hv-cinder-84299 May 23 17:27:10.167361 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-1c2d93a8-3767-4c50-b543-87a0249f6a3c req-ef2f209d-24bb-4aaa-b751-42796da7008a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029646 May 23 17:27:10.168262 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 466/916] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:27:18.908873 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:27:18.909931 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:27:18.914606 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-bf88ad24-3569-41fe-a485-a0631d7dcbdc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:27:18.915157 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-bf88ad24-3569-41fe-a485-a0631d7dcbdc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: e5999132-3aae-47fa-a682-d7a15c98d074] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:27:18.923667 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bf88ad24-3569-41fe-a485-a0631d7dcbdc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:18.924178 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bf88ad24-3569-41fe-a485-a0631d7dcbdc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:18.925072 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bf88ad24-3569-41fe-a485-a0631d7dcbdc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:18.925517 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bf88ad24-3569-41fe-a485-a0631d7dcbdc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:18.951052 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-bf88ad24-3569-41fe-a485-a0631d7dcbdc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074/ips" status: 200 len: 146 microversion: 2.1 time: 0.043733 May 23 17:27:18.951617 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 451/917] 10.222.0.46 () {58 vars in 1247 bytes} [Mon May 23 17:27:18 2022] GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074/ips => generated 146 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:27:20.287793 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=27 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:27:20.288549 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=70 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:27:20.293830 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-833ae9ca-eda9-44f8-8013-7faa9890edc3 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "522e8774-e192-4062-8715-95266eb77b8a"}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:27:20.295277 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-833ae9ca-eda9-44f8-8013-7faa9890edc3 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: e5999132-3aae-47fa-a682-d7a15c98d074] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:27:20.303528 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-833ae9ca-eda9-44f8-8013-7faa9890edc3 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:20.303971 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-833ae9ca-eda9-44f8-8013-7faa9890edc3 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:20.304803 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-833ae9ca-eda9-44f8-8013-7faa9890edc3 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:20.305244 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-833ae9ca-eda9-44f8-8013-7faa9890edc3 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:20.591053 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-833ae9ca-eda9-44f8-8013-7faa9890edc3 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "POST /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305245 May 23 17:27:20.591692 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 467/918] 10.222.0.46 () {60 vars in 1322 bytes} [Mon May 23 17:27:20 2022] POST /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:27:27.091238 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1af94d15-0280-4b21-b6ed-088b2c7402c8 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:27:27.092171 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1af94d15-0280-4b21-b6ed-088b2c7402c8 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: e5999132-3aae-47fa-a682-d7a15c98d074] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:27:27.099252 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1af94d15-0280-4b21-b6ed-088b2c7402c8 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:27.099700 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1af94d15-0280-4b21-b6ed-088b2c7402c8 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:27.100463 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1af94d15-0280-4b21-b6ed-088b2c7402c8 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:27.100925 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1af94d15-0280-4b21-b6ed-088b2c7402c8 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:27.131842 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1af94d15-0280-4b21-b6ed-088b2c7402c8 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044640 May 23 17:27:27.132437 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 452/919] 10.222.0.46 () {58 vars in 1301 bytes} [Mon May 23 17:27:27 2022] GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:27:27.144141 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-f1ca066e-1e7c-4fdf-ae67-52468ba3d419 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:27:27.144809 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-f1ca066e-1e7c-4fdf-ae67-52468ba3d419 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: e5999132-3aae-47fa-a682-d7a15c98d074] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:27:27.151458 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f1ca066e-1e7c-4fdf-ae67-52468ba3d419 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:27.151902 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f1ca066e-1e7c-4fdf-ae67-52468ba3d419 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:27.152707 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f1ca066e-1e7c-4fdf-ae67-52468ba3d419 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:27.153138 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f1ca066e-1e7c-4fdf-ae67-52468ba3d419 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:27.184415 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-f1ca066e-1e7c-4fdf-ae67-52468ba3d419 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074/os-volume_attachments/522e8774-e192-4062-8715-95266eb77b8a" status: 200 len: 194 microversion: 2.1 time: 0.045201 May 23 17:27:27.185019 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 468/920] 10.222.0.46 () {58 vars in 1412 bytes} [Mon May 23 17:27:27 2022] GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074/os-volume_attachments/522e8774-e192-4062-8715-95266eb77b8a => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:27:28.534443 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5ab70a37-cffd-4348-acbd-8f36afaf7891 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c9d4f4d-fab6-4967-b76f-77d734df6c1f"}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:27:28.535489 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5ab70a37-cffd-4348-acbd-8f36afaf7891 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: e5999132-3aae-47fa-a682-d7a15c98d074] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:27:28.542103 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5ab70a37-cffd-4348-acbd-8f36afaf7891 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:28.542553 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5ab70a37-cffd-4348-acbd-8f36afaf7891 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:28.543396 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5ab70a37-cffd-4348-acbd-8f36afaf7891 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:28.543838 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5ab70a37-cffd-4348-acbd-8f36afaf7891 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:28.804761 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5ab70a37-cffd-4348-acbd-8f36afaf7891 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "POST /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274130 May 23 17:27:28.805388 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 453/921] 10.222.0.46 () {60 vars in 1322 bytes} [Mon May 23 17:27:28 2022] POST /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:27:36.359475 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a50b76ed-f529-497a-935b-2c6c8473a185 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:27:36.360415 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-a50b76ed-f529-497a-935b-2c6c8473a185 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: e5999132-3aae-47fa-a682-d7a15c98d074] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:27:36.367612 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a50b76ed-f529-497a-935b-2c6c8473a185 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:36.368060 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a50b76ed-f529-497a-935b-2c6c8473a185 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:36.368866 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a50b76ed-f529-497a-935b-2c6c8473a185 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:36.369301 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a50b76ed-f529-497a-935b-2c6c8473a185 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:36.399447 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-a50b76ed-f529-497a-935b-2c6c8473a185 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043927 May 23 17:27:36.400014 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 469/922] 10.222.0.46 () {58 vars in 1301 bytes} [Mon May 23 17:27:36 2022] GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:27:36.541996 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c41db40f-c308-4470-a4a2-fba48b2414e6 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:27:36.542582 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c41db40f-c308-4470-a4a2-fba48b2414e6 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: e5999132-3aae-47fa-a682-d7a15c98d074] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:27:36.549659 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c41db40f-c308-4470-a4a2-fba48b2414e6 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:36.550133 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c41db40f-c308-4470-a4a2-fba48b2414e6 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:36.550908 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c41db40f-c308-4470-a4a2-fba48b2414e6 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:36.551348 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c41db40f-c308-4470-a4a2-fba48b2414e6 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:36.580583 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c41db40f-c308-4470-a4a2-fba48b2414e6 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074/os-volume_attachments/522e8774-e192-4062-8715-95266eb77b8a" status: 200 len: 194 microversion: 2.1 time: 0.043751 May 23 17:27:36.581183 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 454/923] 10.222.0.46 () {58 vars in 1412 bytes} [Mon May 23 17:27:36 2022] GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074/os-volume_attachments/522e8774-e192-4062-8715-95266eb77b8a => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:27:36.592516 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-058a200f-c8d5-4eb8-9c2c-2dad92b066a5 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:27:36.593064 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-058a200f-c8d5-4eb8-9c2c-2dad92b066a5 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: e5999132-3aae-47fa-a682-d7a15c98d074] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:27:36.599429 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-058a200f-c8d5-4eb8-9c2c-2dad92b066a5 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:36.599910 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-058a200f-c8d5-4eb8-9c2c-2dad92b066a5 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:36.600705 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-058a200f-c8d5-4eb8-9c2c-2dad92b066a5 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:36.601134 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-058a200f-c8d5-4eb8-9c2c-2dad92b066a5 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:36.683118 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.objects.instance [None req-058a200f-c8d5-4eb8-9c2c-2dad92b066a5 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lazy-loading 'services' on Instance uuid e5999132-3aae-47fa-a682-d7a15c98d074 {{(pid=117910) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 17:27:36.766822 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-058a200f-c8d5-4eb8-9c2c-2dad92b066a5 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074/os-volume_attachments/522e8774-e192-4062-8715-95266eb77b8a" status: 202 len: 0 microversion: 2.1 time: 0.178086 May 23 17:27:36.767854 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 470/924] 10.222.0.46 () {58 vars in 1415 bytes} [Mon May 23 17:27:36 2022] DELETE /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074/os-volume_attachments/522e8774-e192-4062-8715-95266eb77b8a => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 17:27:37.887435 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-426c43f7-8be4-4641-bbe9-9391ba3f6de8 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:27:37.887988 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-426c43f7-8be4-4641-bbe9-9391ba3f6de8 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: e5999132-3aae-47fa-a682-d7a15c98d074] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:27:37.894760 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-426c43f7-8be4-4641-bbe9-9391ba3f6de8 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:37.895205 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-426c43f7-8be4-4641-bbe9-9391ba3f6de8 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:37.895966 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-426c43f7-8be4-4641-bbe9-9391ba3f6de8 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:37.896397 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-426c43f7-8be4-4641-bbe9-9391ba3f6de8 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:37.925805 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-426c43f7-8be4-4641-bbe9-9391ba3f6de8 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074/os-volume_attachments/7c9d4f4d-fab6-4967-b76f-77d734df6c1f" status: 200 len: 194 microversion: 2.1 time: 0.042796 May 23 17:27:37.926375 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 455/925] 10.222.0.46 () {58 vars in 1412 bytes} [Mon May 23 17:27:37 2022] GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074/os-volume_attachments/7c9d4f4d-fab6-4967-b76f-77d734df6c1f => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:27:37.939859 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-532e8fcb-8580-4f77-bb56-b2304f2ca2a6 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:27:37.940408 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-532e8fcb-8580-4f77-bb56-b2304f2ca2a6 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: e5999132-3aae-47fa-a682-d7a15c98d074] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:27:37.947195 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-532e8fcb-8580-4f77-bb56-b2304f2ca2a6 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:37.947645 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-532e8fcb-8580-4f77-bb56-b2304f2ca2a6 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:37.948413 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-532e8fcb-8580-4f77-bb56-b2304f2ca2a6 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:37.948884 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-532e8fcb-8580-4f77-bb56-b2304f2ca2a6 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:38.030532 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.objects.instance [None req-532e8fcb-8580-4f77-bb56-b2304f2ca2a6 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lazy-loading 'services' on Instance uuid e5999132-3aae-47fa-a682-d7a15c98d074 {{(pid=117910) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 17:27:38.106427 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-532e8fcb-8580-4f77-bb56-b2304f2ca2a6 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074/os-volume_attachments/7c9d4f4d-fab6-4967-b76f-77d734df6c1f" status: 202 len: 0 microversion: 2.1 time: 0.171325 May 23 17:27:38.107092 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 471/926] 10.222.0.46 () {58 vars in 1415 bytes} [Mon May 23 17:27:37 2022] DELETE /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074/os-volume_attachments/7c9d4f4d-fab6-4967-b76f-77d734df6c1f => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 17:27:39.291023 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9d839d31-c019-433a-89d2-138bf4eeedb5 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:27:39.292047 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9d839d31-c019-433a-89d2-138bf4eeedb5 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: e5999132-3aae-47fa-a682-d7a15c98d074] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:27:39.299024 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9d839d31-c019-433a-89d2-138bf4eeedb5 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:39.299485 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9d839d31-c019-433a-89d2-138bf4eeedb5 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:39.300255 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9d839d31-c019-433a-89d2-138bf4eeedb5 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:39.300723 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9d839d31-c019-433a-89d2-138bf4eeedb5 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:39.332296 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9d839d31-c019-433a-89d2-138bf4eeedb5 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045442 May 23 17:27:39.332899 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 456/927] 10.222.0.46 () {58 vars in 1301 bytes} [Mon May 23 17:27:39 2022] GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 17:27:39.457288 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d0b68abe-4f49-457a-8fef-f86a81dfffce tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:27:39.458377 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d0b68abe-4f49-457a-8fef-f86a81dfffce tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: e5999132-3aae-47fa-a682-d7a15c98d074] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:27:39.465612 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d0b68abe-4f49-457a-8fef-f86a81dfffce tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:39.466074 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d0b68abe-4f49-457a-8fef-f86a81dfffce tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:39.466847 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d0b68abe-4f49-457a-8fef-f86a81dfffce tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:39.467292 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d0b68abe-4f49-457a-8fef-f86a81dfffce tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:39.497657 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d0b68abe-4f49-457a-8fef-f86a81dfffce tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044613 May 23 17:27:39.498136 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 472/928] 10.222.0.46 () {58 vars in 1301 bytes} [Mon May 23 17:27:39 2022] GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 17:27:39.563840 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9f446369-36b8-4c2d-a448-7021f6b63677 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:27:39.564353 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9f446369-36b8-4c2d-a448-7021f6b63677 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: e5999132-3aae-47fa-a682-d7a15c98d074] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:27:39.570743 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9f446369-36b8-4c2d-a448-7021f6b63677 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:39.571195 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9f446369-36b8-4c2d-a448-7021f6b63677 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:39.571956 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9f446369-36b8-4c2d-a448-7021f6b63677 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:39.572638 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9f446369-36b8-4c2d-a448-7021f6b63677 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:39.597250 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9f446369-36b8-4c2d-a448-7021f6b63677 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: e5999132-3aae-47fa-a682-d7a15c98d074] Going to try to terminate instance {{(pid=117909) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 17:27:39.674954 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9f446369-36b8-4c2d-a448-7021f6b63677 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074" status: 204 len: 0 microversion: 2.1 time: 0.115009 May 23 17:27:39.675603 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 457/929] 10.222.0.46 () {58 vars in 1238 bytes} [Mon May 23 17:27:39 2022] DELETE /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 17:27:39.685225 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2978d63c-74a9-40d3-9d69-0749a4e56533 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:27:39.686073 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2978d63c-74a9-40d3-9d69-0749a4e56533 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: e5999132-3aae-47fa-a682-d7a15c98d074] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:27:39.692226 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2978d63c-74a9-40d3-9d69-0749a4e56533 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:39.692719 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2978d63c-74a9-40d3-9d69-0749a4e56533 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:39.693492 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2978d63c-74a9-40d3-9d69-0749a4e56533 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:39.693932 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2978d63c-74a9-40d3-9d69-0749a4e56533 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:39.835635 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2978d63c-74a9-40d3-9d69-0749a4e56533 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:27:39.847853 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2978d63c-74a9-40d3-9d69-0749a4e56533 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074" status: 200 len: 1673 microversion: 2.1 time: 0.166502 May 23 17:27:39.848737 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 473/930] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:27:39 2022] GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074 => generated 1673 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:27:40.869538 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-47d53749-29b4-4666-ac5a-933fae5963fa tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:27:40.870333 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-47d53749-29b4-4666-ac5a-933fae5963fa tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: e5999132-3aae-47fa-a682-d7a15c98d074] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:27:40.880270 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-47d53749-29b4-4666-ac5a-933fae5963fa tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:40.880980 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-47d53749-29b4-4666-ac5a-933fae5963fa tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:40.883054 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-47d53749-29b4-4666-ac5a-933fae5963fa tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:40.883500 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-47d53749-29b4-4666-ac5a-933fae5963fa tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:41.031078 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-47d53749-29b4-4666-ac5a-933fae5963fa tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:27:41.043059 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-47d53749-29b4-4666-ac5a-933fae5963fa tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074" status: 200 len: 1673 microversion: 2.1 time: 0.180235 May 23 17:27:41.043964 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 458/931] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:27:40 2022] GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074 => generated 1673 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:27:42.061023 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2668f083-dcc2-4b55-8728-316e93e1e3dc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:27:42.061588 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2668f083-dcc2-4b55-8728-316e93e1e3dc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: e5999132-3aae-47fa-a682-d7a15c98d074] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:27:42.068627 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2668f083-dcc2-4b55-8728-316e93e1e3dc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:42.069192 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2668f083-dcc2-4b55-8728-316e93e1e3dc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:42.069967 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2668f083-dcc2-4b55-8728-316e93e1e3dc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:42.070398 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2668f083-dcc2-4b55-8728-316e93e1e3dc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:42.155357 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2668f083-dcc2-4b55-8728-316e93e1e3dc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6943ae00467244228fa6ac90e48c4cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054a5a15ef3c4200b1a78a890b077a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:27:42.165749 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2668f083-dcc2-4b55-8728-316e93e1e3dc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074" status: 200 len: 1605 microversion: 2.1 time: 0.108583 May 23 17:27:42.166680 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 474/932] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:27:42 2022] GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074 => generated 1605 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:27:42.263259 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-620b97fb-2f18-4db4-935f-ce82d897e063 req-25530d2c-a342-47a9-ac95-9b18d351fd5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5999132-3aae-47fa-a682-d7a15c98d074", "name": "network-vif-deleted", "tag": "a83ba6f0-c446-4fd2-9984-03f38a1f8d01"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:27:42.274475 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-620b97fb-2f18-4db4-935f-ce82d897e063 req-25530d2c-a342-47a9-ac95-9b18d351fd5b service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:42.274910 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-620b97fb-2f18-4db4-935f-ce82d897e063 req-25530d2c-a342-47a9-ac95-9b18d351fd5b service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:42.288246 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-620b97fb-2f18-4db4-935f-ce82d897e063 req-25530d2c-a342-47a9-ac95-9b18d351fd5b service nova] Creating event network-vif-deleted:a83ba6f0-c446-4fd2-9984-03f38a1f8d01 for instance e5999132-3aae-47fa-a682-d7a15c98d074 on hv-cinder-84299 May 23 17:27:42.294937 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-620b97fb-2f18-4db4-935f-ce82d897e063 req-25530d2c-a342-47a9-ac95-9b18d351fd5b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035371 May 23 17:27:42.295832 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 459/933] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:27:43.183841 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c69a240d-9bac-452e-a053-3bbc6a63d0cc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:27:43.184438 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c69a240d-9bac-452e-a053-3bbc6a63d0cc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: e5999132-3aae-47fa-a682-d7a15c98d074] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:27:43.191407 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c69a240d-9bac-452e-a053-3bbc6a63d0cc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:43.191863 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c69a240d-9bac-452e-a053-3bbc6a63d0cc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:43.192680 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c69a240d-9bac-452e-a053-3bbc6a63d0cc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:43.193117 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c69a240d-9bac-452e-a053-3bbc6a63d0cc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:43.207502 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-c69a240d-9bac-452e-a053-3bbc6a63d0cc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] HTTP exception thrown: Instance e5999132-3aae-47fa-a682-d7a15c98d074 could not be found. May 23 17:27:43.209224 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c69a240d-9bac-452e-a053-3bbc6a63d0cc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Request method failure captured: May 23 17:27:43.209224 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: request: GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074 HTTP/1.1 May 23 17:27:43.209224 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept: application/json May 23 17:27:43.209224 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity May 23 17:27:43.209224 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Connection: close May 23 17:27:43.209224 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Length: 0 May 23 17:27:43.209224 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Type: application/json May 23 17:27:43.209224 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Host: 10.222.0.46 May 23 17:27:43.209224 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None May 23 17:27:43.209224 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.9 May 23 17:27:43.209224 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABii8MWau2OWjWGasfBQDC3wajHrbDXx2FwIG6MDVHKf8k25AnkioePrVTsqu8f3OSf-QCKjBISOw6wcTtEz4srRwQgqRw5LOpNVQ2wxafmwgeux4Kkf5QWluxIWiM91SC4T1LO8293oDCQD2o-MfEaIreZfySzGXigwQPd7S7riYnpsG0 May 23 17:27:43.209224 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Id: None May 23 17:27:43.209224 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Name: None May 23 17:27:43.209224 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed May 23 17:27:43.209224 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True May 23 17:27:43.209224 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default May 23 17:27:43.209224 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default May 23 17:27:43.209224 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Id: 054a5a15ef3c4200b1a78a890b077a53 May 23 17:27:43.209224 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-AttachVolumeTestJSON-395505802 May 23 17:27:43.209224 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Role: reader,member May 23 17:27:43.209224 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Roles: reader,member May 23 17:27:43.211022 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/054a5a15ef3c4200b1a78a890b077a53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/054a5a15ef3c4200b1a78a890b077a53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/054a5a15ef3c4200b1a78a890b077a53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_054a5a15ef3c4200b1a78a890b077a53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:27:43.211022 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-AttachVolumeTestJSON-395505802 May 23 17:27:43.211022 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 054a5a15ef3c4200b1a78a890b077a53 May 23 17:27:43.211022 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-AttachVolumeTestJSON-395505802 May 23 17:27:43.211022 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User: tempest-AttachVolumeTestJSON-395505802-project May 23 17:27:43.211022 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default May 23 17:27:43.211022 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default May 23 17:27:43.211022 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Id: 6943ae00467244228fa6ac90e48c4cce May 23 17:27:43.211022 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-AttachVolumeTestJSON-395505802-project May 23 17:27:43.211022 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: method: > May 23 17:27:43.211022 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: exception: Instance e5999132-3aae-47fa-a682-d7a15c98d074 could not be found. May 23 17:27:43.211022 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: action_args: {'id': 'e5999132-3aae-47fa-a682-d7a15c98d074'} May 23 17:27:43.212085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:27:43.212085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:27:43.212085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:27:43.212085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:27:43.212085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:27:43.212085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:27:43.212085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:27:43.212085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:27:43.212085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:27:43.212085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:27:43.212085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5999132-3aae-47fa-a682-d7a15c98d074 could not be found. May 23 17:27:43.212085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:27:43.212085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:27:43.212085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:27:43.212085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:27:43.212085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:27:43.212085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:27:43.212085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:27:43.212085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:27:43.212085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:27:43.213764 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:27:43.213764 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 17:27:43.213764 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 17:27:43.213764 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:27:43.213764 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:27:43.213764 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:27:43.213764 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:27:43.213764 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5999132-3aae-47fa-a682-d7a15c98d074 could not be found. May 23 17:27:43.213764 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:27:43.213764 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:27:43.213764 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:27:43.213764 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:27:43.213764 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:27:43.213764 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:27:43.213764 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:27:43.213764 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:27:43.213764 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5999132-3aae-47fa-a682-d7a15c98d074 could not be found. May 23 17:27:43.213764 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:27:43.215473 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c69a240d-9bac-452e-a053-3bbc6a63d0cc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Returning 404 to user: Instance e5999132-3aae-47fa-a682-d7a15c98d074 could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:27:43.215473 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c69a240d-9bac-452e-a053-3bbc6a63d0cc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074" status: 404 len: 111 microversion: 2.1 time: 0.030875 May 23 17:27:43.215473 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 475/934] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:27:43 2022] GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:27:43.221199 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-83e835c7-3249-4f6a-bdad-89a52abf7a1b tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '.version_select at 0x7fd793d113a0>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:27:43.241456 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-83e835c7-3249-4f6a-bdad-89a52abf7a1b tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-639944184" status: 202 len: 0 microversion: 2.1 time: 0.024954 May 23 17:27:43.242060 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 460/935] 10.222.0.46 () {58 vars in 1217 bytes} [Mon May 23 17:27:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-639944184 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 17:27:46.143071 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-58724e1c-b1be-47ca-be96-827c859603dc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:27:46.143592 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-58724e1c-b1be-47ca-be96-827c859603dc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: e5999132-3aae-47fa-a682-d7a15c98d074] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:27:46.150583 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-58724e1c-b1be-47ca-be96-827c859603dc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:46.151032 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-58724e1c-b1be-47ca-be96-827c859603dc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:46.151800 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-58724e1c-b1be-47ca-be96-827c859603dc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:46.152240 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-58724e1c-b1be-47ca-be96-827c859603dc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:46.168023 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-58724e1c-b1be-47ca-be96-827c859603dc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] HTTP exception thrown: Instance e5999132-3aae-47fa-a682-d7a15c98d074 could not be found. May 23 17:27:46.169568 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-58724e1c-b1be-47ca-be96-827c859603dc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Request method failure captured: May 23 17:27:46.169568 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: request: DELETE /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074 HTTP/1.1 May 23 17:27:46.169568 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept: application/json May 23 17:27:46.169568 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity May 23 17:27:46.169568 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Connection: close May 23 17:27:46.169568 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Length: 0 May 23 17:27:46.169568 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Type: application/json May 23 17:27:46.169568 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Host: 10.222.0.46 May 23 17:27:46.169568 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None May 23 17:27:46.169568 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.9 May 23 17:27:46.169568 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABii8MWau2OWjWGasfBQDC3wajHrbDXx2FwIG6MDVHKf8k25AnkioePrVTsqu8f3OSf-QCKjBISOw6wcTtEz4srRwQgqRw5LOpNVQ2wxafmwgeux4Kkf5QWluxIWiM91SC4T1LO8293oDCQD2o-MfEaIreZfySzGXigwQPd7S7riYnpsG0 May 23 17:27:46.169568 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Id: None May 23 17:27:46.169568 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Name: None May 23 17:27:46.169568 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed May 23 17:27:46.169568 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True May 23 17:27:46.169568 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default May 23 17:27:46.169568 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default May 23 17:27:46.169568 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Id: 054a5a15ef3c4200b1a78a890b077a53 May 23 17:27:46.169568 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-AttachVolumeTestJSON-395505802 May 23 17:27:46.169568 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Role: reader,member May 23 17:27:46.169568 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Roles: reader,member May 23 17:27:46.171339 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/054a5a15ef3c4200b1a78a890b077a53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/054a5a15ef3c4200b1a78a890b077a53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/054a5a15ef3c4200b1a78a890b077a53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_054a5a15ef3c4200b1a78a890b077a53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:27:46.171339 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-AttachVolumeTestJSON-395505802 May 23 17:27:46.171339 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 054a5a15ef3c4200b1a78a890b077a53 May 23 17:27:46.171339 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-AttachVolumeTestJSON-395505802 May 23 17:27:46.171339 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User: tempest-AttachVolumeTestJSON-395505802-project May 23 17:27:46.171339 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default May 23 17:27:46.171339 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default May 23 17:27:46.171339 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Id: 6943ae00467244228fa6ac90e48c4cce May 23 17:27:46.171339 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-AttachVolumeTestJSON-395505802-project May 23 17:27:46.171339 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: method: > May 23 17:27:46.171339 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: exception: Instance e5999132-3aae-47fa-a682-d7a15c98d074 could not be found. May 23 17:27:46.171339 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: action_args: {'id': 'e5999132-3aae-47fa-a682-d7a15c98d074'} May 23 17:27:46.172187 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:27:46.172187 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:27:46.172187 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:27:46.172187 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:27:46.172187 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:27:46.172187 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:27:46.172187 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:27:46.172187 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:27:46.172187 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:27:46.172187 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:27:46.172187 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5999132-3aae-47fa-a682-d7a15c98d074 could not be found. May 23 17:27:46.172187 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:27:46.172187 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:27:46.172187 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:27:46.172187 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:27:46.172187 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:27:46.172187 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:27:46.172187 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:27:46.172187 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:27:46.172187 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:27:46.173654 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:27:46.173654 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 17:27:46.173654 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 17:27:46.173654 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 17:27:46.173654 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 17:27:46.173654 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:27:46.173654 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:27:46.173654 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:27:46.173654 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:27:46.173654 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5999132-3aae-47fa-a682-d7a15c98d074 could not be found. May 23 17:27:46.173654 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:27:46.173654 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:27:46.173654 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:27:46.173654 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:27:46.173654 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:27:46.173654 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:27:46.173654 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:27:46.173654 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:27:46.173654 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5999132-3aae-47fa-a682-d7a15c98d074 could not be found. May 23 17:27:46.173654 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:27:46.175337 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-58724e1c-b1be-47ca-be96-827c859603dc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Returning 404 to user: Instance e5999132-3aae-47fa-a682-d7a15c98d074 could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:27:46.175337 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-58724e1c-b1be-47ca-be96-827c859603dc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074" status: 404 len: 111 microversion: 2.1 time: 0.031847 May 23 17:27:46.175337 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 476/936] 10.222.0.46 () {58 vars in 1238 bytes} [Mon May 23 17:27:46 2022] DELETE /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:27:46.181103 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e241dcbe-b2c2-47a6-98fc-20f66cf11eb2 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:27:46.181772 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e241dcbe-b2c2-47a6-98fc-20f66cf11eb2 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: e5999132-3aae-47fa-a682-d7a15c98d074] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:27:46.188453 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e241dcbe-b2c2-47a6-98fc-20f66cf11eb2 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:46.188806 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e241dcbe-b2c2-47a6-98fc-20f66cf11eb2 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:46.189608 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e241dcbe-b2c2-47a6-98fc-20f66cf11eb2 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:46.190085 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e241dcbe-b2c2-47a6-98fc-20f66cf11eb2 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:46.203786 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-e241dcbe-b2c2-47a6-98fc-20f66cf11eb2 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] HTTP exception thrown: Instance e5999132-3aae-47fa-a682-d7a15c98d074 could not be found. May 23 17:27:46.205479 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e241dcbe-b2c2-47a6-98fc-20f66cf11eb2 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Request method failure captured: May 23 17:27:46.205479 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: request: GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074 HTTP/1.1 May 23 17:27:46.205479 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept: application/json May 23 17:27:46.205479 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity May 23 17:27:46.205479 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Connection: close May 23 17:27:46.205479 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Length: 0 May 23 17:27:46.205479 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Type: application/json May 23 17:27:46.205479 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Host: 10.222.0.46 May 23 17:27:46.205479 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None May 23 17:27:46.205479 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.9 May 23 17:27:46.205479 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABii8MWau2OWjWGasfBQDC3wajHrbDXx2FwIG6MDVHKf8k25AnkioePrVTsqu8f3OSf-QCKjBISOw6wcTtEz4srRwQgqRw5LOpNVQ2wxafmwgeux4Kkf5QWluxIWiM91SC4T1LO8293oDCQD2o-MfEaIreZfySzGXigwQPd7S7riYnpsG0 May 23 17:27:46.205479 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Id: None May 23 17:27:46.205479 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Name: None May 23 17:27:46.205479 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed May 23 17:27:46.205479 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True May 23 17:27:46.205479 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default May 23 17:27:46.205479 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default May 23 17:27:46.205479 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Id: 054a5a15ef3c4200b1a78a890b077a53 May 23 17:27:46.205479 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-AttachVolumeTestJSON-395505802 May 23 17:27:46.205479 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Role: reader,member May 23 17:27:46.205479 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Roles: reader,member May 23 17:27:46.207104 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/054a5a15ef3c4200b1a78a890b077a53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/054a5a15ef3c4200b1a78a890b077a53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/054a5a15ef3c4200b1a78a890b077a53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_054a5a15ef3c4200b1a78a890b077a53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:27:46.207104 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-AttachVolumeTestJSON-395505802 May 23 17:27:46.207104 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 054a5a15ef3c4200b1a78a890b077a53 May 23 17:27:46.207104 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-AttachVolumeTestJSON-395505802 May 23 17:27:46.207104 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User: tempest-AttachVolumeTestJSON-395505802-project May 23 17:27:46.207104 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default May 23 17:27:46.207104 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default May 23 17:27:46.207104 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Id: 6943ae00467244228fa6ac90e48c4cce May 23 17:27:46.207104 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-AttachVolumeTestJSON-395505802-project May 23 17:27:46.207104 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: method: > May 23 17:27:46.207104 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: exception: Instance e5999132-3aae-47fa-a682-d7a15c98d074 could not be found. May 23 17:27:46.207104 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: action_args: {'id': 'e5999132-3aae-47fa-a682-d7a15c98d074'} May 23 17:27:46.208026 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:27:46.208026 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:27:46.208026 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:27:46.208026 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:27:46.208026 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:27:46.208026 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:27:46.208026 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:27:46.208026 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:27:46.208026 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:27:46.208026 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:27:46.208026 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5999132-3aae-47fa-a682-d7a15c98d074 could not be found. May 23 17:27:46.208026 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:27:46.208026 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:27:46.208026 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:27:46.208026 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:27:46.208026 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:27:46.208026 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:27:46.208026 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:27:46.208026 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:27:46.208026 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:27:46.209627 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:27:46.209627 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 17:27:46.209627 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 17:27:46.209627 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:27:46.209627 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:27:46.209627 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:27:46.209627 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:27:46.209627 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5999132-3aae-47fa-a682-d7a15c98d074 could not be found. May 23 17:27:46.209627 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:27:46.209627 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:27:46.209627 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:27:46.209627 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:27:46.209627 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:27:46.209627 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:27:46.209627 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:27:46.209627 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:27:46.209627 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5999132-3aae-47fa-a682-d7a15c98d074 could not be found. May 23 17:27:46.209627 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:27:46.210917 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e241dcbe-b2c2-47a6-98fc-20f66cf11eb2 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Returning 404 to user: Instance e5999132-3aae-47fa-a682-d7a15c98d074 could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:27:46.210917 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e241dcbe-b2c2-47a6-98fc-20f66cf11eb2 tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074" status: 404 len: 111 microversion: 2.1 time: 0.030493 May 23 17:27:46.210917 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 461/937] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:27:46 2022] GET /compute/v2.1/servers/e5999132-3aae-47fa-a682-d7a15c98d074 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:27:46.403598 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-bd29f128-8388-4f8f-89d0-f1d531df8bdd tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:27:46.404160 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-bd29f128-8388-4f8f-89d0-f1d531df8bdd tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: ca5370ce-8356-449c-be5b-fb4c0afb4080] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:27:46.410433 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bd29f128-8388-4f8f-89d0-f1d531df8bdd tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:46.411023 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bd29f128-8388-4f8f-89d0-f1d531df8bdd tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:46.411710 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bd29f128-8388-4f8f-89d0-f1d531df8bdd tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:46.412194 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bd29f128-8388-4f8f-89d0-f1d531df8bdd tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:46.438294 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-bd29f128-8388-4f8f-89d0-f1d531df8bdd tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080/ips" status: 200 len: 151 microversion: 2.1 time: 0.039068 May 23 17:27:46.438872 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 477/938] 10.222.0.46 () {58 vars in 1247 bytes} [Mon May 23 17:27:46 2022] GET /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:27:47.360338 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f44d4776-9657-4648-a0b0-57b8f10256bc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:27:47.360925 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f44d4776-9657-4648-a0b0-57b8f10256bc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:27:47.367935 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f44d4776-9657-4648-a0b0-57b8f10256bc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:47.368388 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f44d4776-9657-4648-a0b0-57b8f10256bc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:47.369197 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f44d4776-9657-4648-a0b0-57b8f10256bc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:47.369637 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f44d4776-9657-4648-a0b0-57b8f10256bc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:47.383177 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-f44d4776-9657-4648-a0b0-57b8f10256bc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] HTTP exception thrown: Instance 566ee1b1-7455-4a79-84ad-a954fc6a6a96 could not be found. May 23 17:27:47.384743 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f44d4776-9657-4648-a0b0-57b8f10256bc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Request method failure captured: May 23 17:27:47.384743 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: request: DELETE /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 HTTP/1.1 May 23 17:27:47.384743 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept: application/json May 23 17:27:47.384743 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity May 23 17:27:47.384743 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Connection: close May 23 17:27:47.384743 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Length: 0 May 23 17:27:47.384743 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Type: application/json May 23 17:27:47.384743 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Host: 10.222.0.46 May 23 17:27:47.384743 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None May 23 17:27:47.384743 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.9 May 23 17:27:47.384743 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABii8MWau2OWjWGasfBQDC3wajHrbDXx2FwIG6MDVHKf8k25AnkioePrVTsqu8f3OSf-QCKjBISOw6wcTtEz4srRwQgqRw5LOpNVQ2wxafmwgeux4Kkf5QWluxIWiM91SC4T1LO8293oDCQD2o-MfEaIreZfySzGXigwQPd7S7riYnpsG0 May 23 17:27:47.384743 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Id: None May 23 17:27:47.384743 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Name: None May 23 17:27:47.384743 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed May 23 17:27:47.384743 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True May 23 17:27:47.384743 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default May 23 17:27:47.384743 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default May 23 17:27:47.384743 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Id: 054a5a15ef3c4200b1a78a890b077a53 May 23 17:27:47.384743 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-AttachVolumeTestJSON-395505802 May 23 17:27:47.384743 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Role: reader,member May 23 17:27:47.384743 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Roles: reader,member May 23 17:27:47.386683 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/054a5a15ef3c4200b1a78a890b077a53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/054a5a15ef3c4200b1a78a890b077a53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/054a5a15ef3c4200b1a78a890b077a53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_054a5a15ef3c4200b1a78a890b077a53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:27:47.386683 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-AttachVolumeTestJSON-395505802 May 23 17:27:47.386683 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 054a5a15ef3c4200b1a78a890b077a53 May 23 17:27:47.386683 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-AttachVolumeTestJSON-395505802 May 23 17:27:47.386683 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User: tempest-AttachVolumeTestJSON-395505802-project May 23 17:27:47.386683 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default May 23 17:27:47.386683 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default May 23 17:27:47.386683 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Id: 6943ae00467244228fa6ac90e48c4cce May 23 17:27:47.386683 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-AttachVolumeTestJSON-395505802-project May 23 17:27:47.386683 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: method: > May 23 17:27:47.386683 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: exception: Instance 566ee1b1-7455-4a79-84ad-a954fc6a6a96 could not be found. May 23 17:27:47.386683 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: action_args: {'id': '566ee1b1-7455-4a79-84ad-a954fc6a6a96'} May 23 17:27:47.387489 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:27:47.387489 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:27:47.387489 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:27:47.387489 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:27:47.387489 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:27:47.387489 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:27:47.387489 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:27:47.387489 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:27:47.387489 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:27:47.387489 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:27:47.387489 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 566ee1b1-7455-4a79-84ad-a954fc6a6a96 could not be found. May 23 17:27:47.387489 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:27:47.387489 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:27:47.387489 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:27:47.387489 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:27:47.387489 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:27:47.387489 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:27:47.387489 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:27:47.387489 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:27:47.387489 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:27:47.388753 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:27:47.388753 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 17:27:47.388753 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 17:27:47.388753 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 17:27:47.388753 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 17:27:47.388753 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:27:47.388753 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:27:47.388753 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:27:47.388753 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:27:47.388753 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 566ee1b1-7455-4a79-84ad-a954fc6a6a96 could not be found. May 23 17:27:47.388753 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:27:47.388753 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:27:47.388753 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:27:47.388753 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:27:47.388753 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:27:47.388753 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:27:47.388753 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:27:47.388753 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:27:47.388753 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 566ee1b1-7455-4a79-84ad-a954fc6a6a96 could not be found. May 23 17:27:47.388753 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:27:47.390046 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f44d4776-9657-4648-a0b0-57b8f10256bc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Returning 404 to user: Instance 566ee1b1-7455-4a79-84ad-a954fc6a6a96 could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:27:47.390046 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f44d4776-9657-4648-a0b0-57b8f10256bc tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "DELETE /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 404 len: 111 microversion: 2.1 time: 0.029721 May 23 17:27:47.390046 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 462/939] 10.222.0.46 () {58 vars in 1238 bytes} [Mon May 23 17:27:47 2022] DELETE /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:27:47.396699 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b48bacd9-1594-4839-98c7-4651aadadd4a tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:27:47.397318 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-b48bacd9-1594-4839-98c7-4651aadadd4a tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] [instance: 566ee1b1-7455-4a79-84ad-a954fc6a6a96] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:27:47.403921 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b48bacd9-1594-4839-98c7-4651aadadd4a tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:47.404454 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b48bacd9-1594-4839-98c7-4651aadadd4a tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:47.405643 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b48bacd9-1594-4839-98c7-4651aadadd4a tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:47.406243 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b48bacd9-1594-4839-98c7-4651aadadd4a tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:47.421920 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-b48bacd9-1594-4839-98c7-4651aadadd4a tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] HTTP exception thrown: Instance 566ee1b1-7455-4a79-84ad-a954fc6a6a96 could not be found. May 23 17:27:47.423447 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b48bacd9-1594-4839-98c7-4651aadadd4a tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Request method failure captured: May 23 17:27:47.423447 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: request: GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 HTTP/1.1 May 23 17:27:47.423447 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept: application/json May 23 17:27:47.423447 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity May 23 17:27:47.423447 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Connection: close May 23 17:27:47.423447 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Length: 0 May 23 17:27:47.423447 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Type: application/json May 23 17:27:47.423447 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Host: 10.222.0.46 May 23 17:27:47.423447 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None May 23 17:27:47.423447 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.9 May 23 17:27:47.423447 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABii8MWau2OWjWGasfBQDC3wajHrbDXx2FwIG6MDVHKf8k25AnkioePrVTsqu8f3OSf-QCKjBISOw6wcTtEz4srRwQgqRw5LOpNVQ2wxafmwgeux4Kkf5QWluxIWiM91SC4T1LO8293oDCQD2o-MfEaIreZfySzGXigwQPd7S7riYnpsG0 May 23 17:27:47.423447 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Id: None May 23 17:27:47.423447 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Name: None May 23 17:27:47.423447 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed May 23 17:27:47.423447 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True May 23 17:27:47.423447 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default May 23 17:27:47.423447 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default May 23 17:27:47.423447 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Id: 054a5a15ef3c4200b1a78a890b077a53 May 23 17:27:47.423447 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-AttachVolumeTestJSON-395505802 May 23 17:27:47.423447 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Role: reader,member May 23 17:27:47.423447 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Roles: reader,member May 23 17:27:47.424890 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/054a5a15ef3c4200b1a78a890b077a53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/054a5a15ef3c4200b1a78a890b077a53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/054a5a15ef3c4200b1a78a890b077a53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_054a5a15ef3c4200b1a78a890b077a53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:27:47.424890 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-AttachVolumeTestJSON-395505802 May 23 17:27:47.424890 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 054a5a15ef3c4200b1a78a890b077a53 May 23 17:27:47.424890 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-AttachVolumeTestJSON-395505802 May 23 17:27:47.424890 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User: tempest-AttachVolumeTestJSON-395505802-project May 23 17:27:47.424890 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default May 23 17:27:47.424890 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default May 23 17:27:47.424890 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Id: 6943ae00467244228fa6ac90e48c4cce May 23 17:27:47.424890 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-AttachVolumeTestJSON-395505802-project May 23 17:27:47.424890 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: method: > May 23 17:27:47.424890 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: exception: Instance 566ee1b1-7455-4a79-84ad-a954fc6a6a96 could not be found. May 23 17:27:47.424890 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: action_args: {'id': '566ee1b1-7455-4a79-84ad-a954fc6a6a96'} May 23 17:27:47.425646 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:27:47.425646 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:27:47.425646 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:27:47.425646 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:27:47.425646 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:27:47.425646 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:27:47.425646 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:27:47.425646 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:27:47.425646 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:27:47.425646 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:27:47.425646 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 566ee1b1-7455-4a79-84ad-a954fc6a6a96 could not be found. May 23 17:27:47.425646 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:27:47.425646 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:27:47.425646 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:27:47.425646 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:27:47.425646 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:27:47.425646 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:27:47.425646 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:27:47.425646 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:27:47.425646 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:27:47.426884 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:27:47.426884 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 17:27:47.426884 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 17:27:47.426884 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:27:47.426884 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:27:47.426884 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:27:47.426884 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:27:47.426884 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 566ee1b1-7455-4a79-84ad-a954fc6a6a96 could not be found. May 23 17:27:47.426884 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:27:47.426884 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:27:47.426884 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:27:47.426884 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:27:47.426884 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:27:47.426884 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:27:47.426884 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:27:47.426884 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:27:47.426884 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 566ee1b1-7455-4a79-84ad-a954fc6a6a96 could not be found. May 23 17:27:47.426884 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:27:47.427971 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b48bacd9-1594-4839-98c7-4651aadadd4a tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] Returning 404 to user: Instance 566ee1b1-7455-4a79-84ad-a954fc6a6a96 could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:27:47.427971 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b48bacd9-1594-4839-98c7-4651aadadd4a tempest-AttachVolumeTestJSON-395505802 tempest-AttachVolumeTestJSON-395505802-project] 10.222.0.46 "GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96" status: 404 len: 111 microversion: 2.1 time: 0.033648 May 23 17:27:47.427971 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 478/940] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:27:47 2022] GET /compute/v2.1/servers/566ee1b1-7455-4a79-84ad-a954fc6a6a96 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:27:47.757334 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2527566b-02f9-4186-bfb7-f10a9d93358e tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c32207b-8b1c-45bd-8765-26af79624290"}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:27:47.758409 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2527566b-02f9-4186-bfb7-f10a9d93358e tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: ca5370ce-8356-449c-be5b-fb4c0afb4080] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:27:47.764875 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2527566b-02f9-4186-bfb7-f10a9d93358e tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:47.765328 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2527566b-02f9-4186-bfb7-f10a9d93358e tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:47.766137 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2527566b-02f9-4186-bfb7-f10a9d93358e tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:47.766570 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2527566b-02f9-4186-bfb7-f10a9d93358e tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:48.214672 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2527566b-02f9-4186-bfb7-f10a9d93358e tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "POST /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.461176 May 23 17:27:48.215301 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 463/941] 10.222.0.46 () {60 vars in 1322 bytes} [Mon May 23 17:27:47 2022] POST /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080/os-volume_attachments => generated 194 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:27:54.696985 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-5643c0c1-4d09-47cd-ad51-f970f5ea3e7f tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c32207b-8b1c-45bd-8765-26af79624290"}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:27:54.698120 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-5643c0c1-4d09-47cd-ad51-f970f5ea3e7f tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: ca5370ce-8356-449c-be5b-fb4c0afb4080] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:27:54.700666 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=25 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:27:54.706128 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5643c0c1-4d09-47cd-ad51-f970f5ea3e7f tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:54.706577 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5643c0c1-4d09-47cd-ad51-f970f5ea3e7f tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:54.707348 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5643c0c1-4d09-47cd-ad51-f970f5ea3e7f tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:54.707789 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5643c0c1-4d09-47cd-ad51-f970f5ea3e7f tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:54.710542 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:27:55.007740 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-5643c0c1-4d09-47cd-ad51-f970f5ea3e7f tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] HTTP exception thrown: Invalid volume: volume 6c32207b-8b1c-45bd-8765-26af79624290 is already attached to instances: ca5370ce-8356-449c-be5b-fb4c0afb4080 May 23 17:27:55.009399 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-5643c0c1-4d09-47cd-ad51-f970f5ea3e7f tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Request method failure captured: May 23 17:27:55.009399 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: request: POST /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080/os-volume_attachments HTTP/1.1 May 23 17:27:55.009399 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept: application/json May 23 17:27:55.009399 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity May 23 17:27:55.009399 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Connection: close May 23 17:27:55.009399 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Length: 74 May 23 17:27:55.009399 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Type: application/json May 23 17:27:55.009399 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Host: 10.222.0.46 May 23 17:27:55.009399 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None May 23 17:27:55.009399 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.9 May 23 17:27:55.009399 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABii8NlLxi80dSOGWL-lavmFeqdu7SsvZyfTIUgOEBMGxHagzi4-1UBzzWbKQ8ofm4C3ey4lzhkyKgnXXkVv8I8JI8XYGl9o7m9yKgGHy9m_tm7J0ml_lU8wosqr4A40dh-VL78ZzvIVJ9JNStDlW1mMD3CLnYBqgsXfzf-XjoMWG-RrH8 May 23 17:27:55.009399 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Id: None May 23 17:27:55.009399 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Name: None May 23 17:27:55.009399 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed May 23 17:27:55.009399 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True May 23 17:27:55.009399 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default May 23 17:27:55.009399 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default May 23 17:27:55.009399 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Id: 43c5da8fa182486990154b6f22539593 May 23 17:27:55.009399 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-AttachVolumeNegativeTest-200847774 May 23 17:27:55.009399 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Role: reader,member May 23 17:27:55.009399 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Roles: reader,member May 23 17:27:55.010887 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43c5da8fa182486990154b6f22539593"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/43c5da8fa182486990154b6f22539593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43c5da8fa182486990154b6f22539593"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_43c5da8fa182486990154b6f22539593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:27:55.010887 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-AttachVolumeNegativeTest-200847774 May 23 17:27:55.010887 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 43c5da8fa182486990154b6f22539593 May 23 17:27:55.010887 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-200847774 May 23 17:27:55.010887 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User: tempest-AttachVolumeNegativeTest-200847774-project May 23 17:27:55.010887 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default May 23 17:27:55.010887 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default May 23 17:27:55.010887 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Id: b4780bb497234a249b6d23afdab14370 May 23 17:27:55.010887 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-AttachVolumeNegativeTest-200847774-project May 23 17:27:55.010887 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: May 23 17:27:55.010887 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: {"volumeAttachment": {"volumeId": "6c32207b-8b1c-45bd-8765-26af79624290"}} May 23 17:27:55.010887 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: method: > May 23 17:27:55.012131 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: exception: Invalid volume: volume 6c32207b-8b1c-45bd-8765-26af79624290 is already attached to instances: ca5370ce-8356-449c-be5b-fb4c0afb4080 May 23 17:27:55.012131 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: action_args: {'server_id': 'ca5370ce-8356-449c-be5b-fb4c0afb4080', 'body': {'volumeAttachment': {'volumeId': '6c32207b-8b1c-45bd-8765-26af79624290'}}} May 23 17:27:55.012131 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:27:55.012131 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:27:55.012131 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 23 17:27:55.012131 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 23 17:27:55.012131 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 17:27:55.012131 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 17:27:55.012131 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 17:27:55.012131 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 17:27:55.012131 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 23 17:27:55.012131 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 23 17:27:55.012131 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 23 17:27:55.012131 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 23 17:27:55.012131 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6c32207b-8b1c-45bd-8765-26af79624290 is already attached to instances: ca5370ce-8356-449c-be5b-fb4c0afb4080 May 23 17:27:55.012131 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:27:55.012131 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:27:55.012131 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:27:55.012131 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:27:55.013396 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:27:55.013396 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:27:55.013396 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:27:55.013396 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:27:55.013396 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:27:55.013396 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:27:55.013396 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 17:27:55.013396 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 17:27:55.013396 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 17:27:55.013396 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 17:27:55.013396 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 17:27:55.013396 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 17:27:55.013396 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 23 17:27:55.013396 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 17:27:55.013396 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6c32207b-8b1c-45bd-8765-26af79624290 is already attached to instances: ca5370ce-8356-449c-be5b-fb4c0afb4080 May 23 17:27:55.013396 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:27:55.013396 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:27:55.013396 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:27:55.013396 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:27:55.013396 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:27:55.014648 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:27:55.014648 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:27:55.014648 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:27:55.014648 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6c32207b-8b1c-45bd-8765-26af79624290 is already attached to instances: ca5370ce-8356-449c-be5b-fb4c0afb4080 May 23 17:27:55.014648 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:27:55.014648 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-5643c0c1-4d09-47cd-ad51-f970f5ea3e7f tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Returning 400 to user: Invalid volume: volume 6c32207b-8b1c-45bd-8765-26af79624290 is already attached to instances: ca5370ce-8356-449c-be5b-fb4c0afb4080 {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:27:55.014648 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-5643c0c1-4d09-47cd-ad51-f970f5ea3e7f tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "POST /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.317945 May 23 17:27:55.015547 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 479/942] 10.222.0.46 () {60 vars in 1322 bytes} [Mon May 23 17:27:54 2022] POST /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080/os-volume_attachments => generated 174 bytes in 323 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 17:27:55.078097 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-eb55e9be-0063-4d5f-b636-4a55a57b2eee tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:27:55.078776 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-eb55e9be-0063-4d5f-b636-4a55a57b2eee tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: ca5370ce-8356-449c-be5b-fb4c0afb4080] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:27:55.080837 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:27:55.086651 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eb55e9be-0063-4d5f-b636-4a55a57b2eee tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:55.087103 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eb55e9be-0063-4d5f-b636-4a55a57b2eee tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:55.087877 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eb55e9be-0063-4d5f-b636-4a55a57b2eee tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:55.088315 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eb55e9be-0063-4d5f-b636-4a55a57b2eee tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:55.093079 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:27:55.174499 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.objects.instance [None req-eb55e9be-0063-4d5f-b636-4a55a57b2eee tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lazy-loading 'services' on Instance uuid ca5370ce-8356-449c-be5b-fb4c0afb4080 {{(pid=117909) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 17:27:55.249116 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-eb55e9be-0063-4d5f-b636-4a55a57b2eee tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080/os-volume_attachments/6c32207b-8b1c-45bd-8765-26af79624290" status: 202 len: 0 microversion: 2.1 time: 0.175712 May 23 17:27:55.249914 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 464/943] 10.222.0.46 () {58 vars in 1415 bytes} [Mon May 23 17:27:55 2022] DELETE /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080/os-volume_attachments/6c32207b-8b1c-45bd-8765-26af79624290 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 17:27:55.258475 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d161fd39-611c-4e0a-857d-00a957295cfe tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:27:55.259456 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d161fd39-611c-4e0a-857d-00a957295cfe tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: ca5370ce-8356-449c-be5b-fb4c0afb4080] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:27:55.272114 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d161fd39-611c-4e0a-857d-00a957295cfe tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:55.272573 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d161fd39-611c-4e0a-857d-00a957295cfe tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:55.273577 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d161fd39-611c-4e0a-857d-00a957295cfe tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:55.274287 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d161fd39-611c-4e0a-857d-00a957295cfe tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:55.306502 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d161fd39-611c-4e0a-857d-00a957295cfe tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052039 May 23 17:27:55.311453 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 480/944] 10.222.0.46 () {58 vars in 1301 bytes} [Mon May 23 17:27:55 2022] GET /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:27:56.322421 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-836d9205-fb41-47eb-9c17-5448db0259b5 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:27:56.323482 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-836d9205-fb41-47eb-9c17-5448db0259b5 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: ca5370ce-8356-449c-be5b-fb4c0afb4080] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:27:56.330274 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-836d9205-fb41-47eb-9c17-5448db0259b5 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:56.330716 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-836d9205-fb41-47eb-9c17-5448db0259b5 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:56.331480 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-836d9205-fb41-47eb-9c17-5448db0259b5 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:56.331912 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-836d9205-fb41-47eb-9c17-5448db0259b5 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:56.366139 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-836d9205-fb41-47eb-9c17-5448db0259b5 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049533 May 23 17:27:56.366896 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 465/945] 10.222.0.46 () {58 vars in 1301 bytes} [Mon May 23 17:27:56 2022] GET /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 17:27:56.430362 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-730cb363-0719-42eb-8c62-e3009e930ec6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:27:56.430885 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-730cb363-0719-42eb-8c62-e3009e930ec6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: ca5370ce-8356-449c-be5b-fb4c0afb4080] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:27:56.437631 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-730cb363-0719-42eb-8c62-e3009e930ec6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:56.438081 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-730cb363-0719-42eb-8c62-e3009e930ec6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:56.438965 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-730cb363-0719-42eb-8c62-e3009e930ec6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:56.439274 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-730cb363-0719-42eb-8c62-e3009e930ec6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:56.464209 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-730cb363-0719-42eb-8c62-e3009e930ec6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: ca5370ce-8356-449c-be5b-fb4c0afb4080] Going to try to terminate instance {{(pid=117910) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 17:27:56.550627 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-730cb363-0719-42eb-8c62-e3009e930ec6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080" status: 204 len: 0 microversion: 2.1 time: 0.125777 May 23 17:27:56.551537 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 481/946] 10.222.0.46 () {58 vars in 1238 bytes} [Mon May 23 17:27:56 2022] DELETE /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 17:27:56.560311 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-900d08d5-fca5-4332-8f4a-1d867bbac1e1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:27:56.561215 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-900d08d5-fca5-4332-8f4a-1d867bbac1e1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: ca5370ce-8356-449c-be5b-fb4c0afb4080] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:27:56.569698 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-900d08d5-fca5-4332-8f4a-1d867bbac1e1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:56.570146 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-900d08d5-fca5-4332-8f4a-1d867bbac1e1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:56.570982 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-900d08d5-fca5-4332-8f4a-1d867bbac1e1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:56.571450 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-900d08d5-fca5-4332-8f4a-1d867bbac1e1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:56.705658 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-900d08d5-fca5-4332-8f4a-1d867bbac1e1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:27:56.713319 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-900d08d5-fca5-4332-8f4a-1d867bbac1e1 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080" status: 200 len: 1683 microversion: 2.1 time: 0.157288 May 23 17:27:56.713904 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 466/947] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:27:56 2022] GET /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:27:57.736032 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-7108098f-104f-46c3-bc01-65b373ecedb7 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:27:57.737233 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-7108098f-104f-46c3-bc01-65b373ecedb7 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: ca5370ce-8356-449c-be5b-fb4c0afb4080] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:27:57.747933 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7108098f-104f-46c3-bc01-65b373ecedb7 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:57.748377 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7108098f-104f-46c3-bc01-65b373ecedb7 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:57.749172 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7108098f-104f-46c3-bc01-65b373ecedb7 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:57.749605 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7108098f-104f-46c3-bc01-65b373ecedb7 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:57.882255 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-7108098f-104f-46c3-bc01-65b373ecedb7 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:27:57.890239 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-7108098f-104f-46c3-bc01-65b373ecedb7 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080" status: 200 len: 1683 microversion: 2.1 time: 0.161716 May 23 17:27:57.890805 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 482/948] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:27:57 2022] GET /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:27:58.882628 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-34d7ee9b-95bd-4cc6-8659-7d33beed04db req-8c5da4f0-d7c4-4964-a7be-6dd85700cfd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca5370ce-8356-449c-be5b-fb4c0afb4080", "name": "network-vif-deleted", "tag": "ed7d2ca4-8fe4-4153-82f8-b5fa35faeb70"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:27:58.893978 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-34d7ee9b-95bd-4cc6-8659-7d33beed04db req-8c5da4f0-d7c4-4964-a7be-6dd85700cfd8 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:58.895067 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-34d7ee9b-95bd-4cc6-8659-7d33beed04db req-8c5da4f0-d7c4-4964-a7be-6dd85700cfd8 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:58.908523 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-6f35db4e-9ecd-4432-9061-53ad77b07fb5 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:27:58.909246 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-6f35db4e-9ecd-4432-9061-53ad77b07fb5 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: ca5370ce-8356-449c-be5b-fb4c0afb4080] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:27:58.911915 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-34d7ee9b-95bd-4cc6-8659-7d33beed04db req-8c5da4f0-d7c4-4964-a7be-6dd85700cfd8 service nova] Creating event network-vif-deleted:ed7d2ca4-8fe4-4153-82f8-b5fa35faeb70 for instance ca5370ce-8356-449c-be5b-fb4c0afb4080 on hv-cinder-84299 May 23 17:27:58.917930 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6f35db4e-9ecd-4432-9061-53ad77b07fb5 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:58.919030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-34d7ee9b-95bd-4cc6-8659-7d33beed04db req-8c5da4f0-d7c4-4964-a7be-6dd85700cfd8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040889 May 23 17:27:58.919170 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6f35db4e-9ecd-4432-9061-53ad77b07fb5 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:58.920746 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 467/949] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:27:58.920891 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6f35db4e-9ecd-4432-9061-53ad77b07fb5 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:27:58.921442 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6f35db4e-9ecd-4432-9061-53ad77b07fb5 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:27:58.997699 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-6f35db4e-9ecd-4432-9061-53ad77b07fb5 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:27:59.017396 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-6f35db4e-9ecd-4432-9061-53ad77b07fb5 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080" status: 200 len: 1326 microversion: 2.1 time: 0.113694 May 23 17:27:59.037490 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 483/950] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:27:58 2022] GET /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080 => generated 1326 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:28:00.035632 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-edda02dc-d7d5-4cc2-99b2-146805ab6322 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:28:00.036334 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-edda02dc-d7d5-4cc2-99b2-146805ab6322 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: ca5370ce-8356-449c-be5b-fb4c0afb4080] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:28:00.042871 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-edda02dc-d7d5-4cc2-99b2-146805ab6322 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:00.043327 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-edda02dc-d7d5-4cc2-99b2-146805ab6322 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:00.044099 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-edda02dc-d7d5-4cc2-99b2-146805ab6322 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:00.044536 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-edda02dc-d7d5-4cc2-99b2-146805ab6322 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:00.058175 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-edda02dc-d7d5-4cc2-99b2-146805ab6322 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] HTTP exception thrown: Instance ca5370ce-8356-449c-be5b-fb4c0afb4080 could not be found. May 23 17:28:00.059834 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-edda02dc-d7d5-4cc2-99b2-146805ab6322 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Request method failure captured: May 23 17:28:00.059834 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: request: GET /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080 HTTP/1.1 May 23 17:28:00.059834 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept: application/json May 23 17:28:00.059834 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity May 23 17:28:00.059834 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Connection: close May 23 17:28:00.059834 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Length: 0 May 23 17:28:00.059834 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Type: application/json May 23 17:28:00.059834 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Host: 10.222.0.46 May 23 17:28:00.059834 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None May 23 17:28:00.059834 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.9 May 23 17:28:00.059834 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABii8NlLxi80dSOGWL-lavmFeqdu7SsvZyfTIUgOEBMGxHagzi4-1UBzzWbKQ8ofm4C3ey4lzhkyKgnXXkVv8I8JI8XYGl9o7m9yKgGHy9m_tm7J0ml_lU8wosqr4A40dh-VL78ZzvIVJ9JNStDlW1mMD3CLnYBqgsXfzf-XjoMWG-RrH8 May 23 17:28:00.059834 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Id: None May 23 17:28:00.059834 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Name: None May 23 17:28:00.059834 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed May 23 17:28:00.059834 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True May 23 17:28:00.059834 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default May 23 17:28:00.059834 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default May 23 17:28:00.059834 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Id: 43c5da8fa182486990154b6f22539593 May 23 17:28:00.059834 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-AttachVolumeNegativeTest-200847774 May 23 17:28:00.059834 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Role: reader,member May 23 17:28:00.059834 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Roles: reader,member May 23 17:28:00.061279 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43c5da8fa182486990154b6f22539593"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/43c5da8fa182486990154b6f22539593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43c5da8fa182486990154b6f22539593"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_43c5da8fa182486990154b6f22539593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:28:00.061279 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-AttachVolumeNegativeTest-200847774 May 23 17:28:00.061279 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 43c5da8fa182486990154b6f22539593 May 23 17:28:00.061279 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-200847774 May 23 17:28:00.061279 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User: tempest-AttachVolumeNegativeTest-200847774-project May 23 17:28:00.061279 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default May 23 17:28:00.061279 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default May 23 17:28:00.061279 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Id: b4780bb497234a249b6d23afdab14370 May 23 17:28:00.061279 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-AttachVolumeNegativeTest-200847774-project May 23 17:28:00.061279 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: method: > May 23 17:28:00.061279 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: exception: Instance ca5370ce-8356-449c-be5b-fb4c0afb4080 could not be found. May 23 17:28:00.061279 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: action_args: {'id': 'ca5370ce-8356-449c-be5b-fb4c0afb4080'} May 23 17:28:00.062030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:28:00.062030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:28:00.062030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:28:00.062030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:28:00.062030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:28:00.062030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:28:00.062030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:28:00.062030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:28:00.062030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:28:00.062030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:28:00.062030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca5370ce-8356-449c-be5b-fb4c0afb4080 could not be found. May 23 17:28:00.062030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:28:00.062030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:28:00.062030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:28:00.062030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:28:00.062030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:28:00.062030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:28:00.062030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:28:00.062030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:28:00.062030 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:28:00.063234 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:28:00.063234 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 17:28:00.063234 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 17:28:00.063234 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:28:00.063234 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:28:00.063234 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:28:00.063234 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:28:00.063234 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca5370ce-8356-449c-be5b-fb4c0afb4080 could not be found. May 23 17:28:00.063234 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:28:00.063234 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:28:00.063234 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:28:00.063234 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:28:00.063234 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:28:00.063234 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:28:00.063234 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:28:00.063234 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:28:00.063234 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca5370ce-8356-449c-be5b-fb4c0afb4080 could not be found. May 23 17:28:00.063234 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:28:00.064338 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-edda02dc-d7d5-4cc2-99b2-146805ab6322 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Returning 404 to user: Instance ca5370ce-8356-449c-be5b-fb4c0afb4080 could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:28:00.064338 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-edda02dc-d7d5-4cc2-99b2-146805ab6322 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080" status: 404 len: 111 microversion: 2.1 time: 0.030440 May 23 17:28:00.064338 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 468/951] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:28:00 2022] GET /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:28:00.070394 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2dd3c5ef-d5e7-436c-b2f9-b25779ab1eff tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '.version_select at 0x7fd7a06f2430>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:28:00.090621 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2dd3c5ef-d5e7-436c-b2f9-b25779ab1eff tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1033895600" status: 202 len: 0 microversion: 2.1 time: 0.024148 May 23 17:28:00.091574 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 484/952] 10.222.0.46 () {58 vars in 1220 bytes} [Mon May 23 17:28:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1033895600 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 17:28:00.740933 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a332fc17-cc69-4a09-bbe1-4057ab7064a5 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Action: 'create', calling method: .version_select at 0x7fd7a11d6040>, body: {"keypair": {"name": "tempest-keypair-592123273", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPtN6bXP/6qONK6E61sgki8beQkUhhi5pe86ykHHJnlQjTHeVrReq0VFRZC47H+c9N27eXrFokODtqi0/+4gwyBkTV9qwxcgAAUu2BnjLq2sHmpNES1OXHXj9FwVbl+gA=="}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:28:00.754800 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-a332fc17-cc69-4a09-bbe1-4057ab7064a5 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Getting quotas for project 43c5da8fa182486990154b6f22539593. Resources: {'key_pairs'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 17:28:00.758929 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-a332fc17-cc69-4a09-bbe1-4057ab7064a5 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Getting quotas for user b4780bb497234a249b6d23afdab14370 and project 43c5da8fa182486990154b6f22539593. Resources: {'key_pairs'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 17:28:00.781831 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a332fc17-cc69-4a09-bbe1-4057ab7064a5 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044998 May 23 17:28:00.782435 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 469/953] 10.222.0.46 () {60 vars in 1158 bytes} [Mon May 23 17:28:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:28:02.130498 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-ced20b06-7c76-4da7-a86b-532e8f21e61d tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-376692297", "imageRef": "99870172-61a4-4218-9407-6a6da3fb5c83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5796957f-d0fc-4cb4-b196-c5a4f17f1ba0"}], "security_groups": [{"name": "tempest-securitygroup--1496986423"}], "key_name": "tempest-keypair-592123273", "user_data": "}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:28:02.237066 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.network.neutron [None req-ced20b06-7c76-4da7-a86b-532e8f21e61d tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] validate_networks() for [('5796957f-d0fc-4cb4-b196-c5a4f17f1ba0', None, None, None, None, None)] {{(pid=117910) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 17:28:02.630775 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-ced20b06-7c76-4da7-a86b-532e8f21e61d tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Flavor limits 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 17:28:02.631275 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-ced20b06-7c76-4da7-a86b-532e8f21e61d tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Image limits 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 17:28:02.631931 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-ced20b06-7c76-4da7-a86b-532e8f21e61d tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Flavor pref 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 17:28:02.632565 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-ced20b06-7c76-4da7-a86b-532e8f21e61d tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Image pref 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 17:28:02.632758 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-ced20b06-7c76-4da7-a86b-532e8f21e61d tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 17:28:02.642397 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ced20b06-7c76-4da7-a86b-532e8f21e61d tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:02.642843 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ced20b06-7c76-4da7-a86b-532e8f21e61d tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:02.643635 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ced20b06-7c76-4da7-a86b-532e8f21e61d tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:02.644074 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ced20b06-7c76-4da7-a86b-532e8f21e61d tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:02.660567 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-ced20b06-7c76-4da7-a86b-532e8f21e61d tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Getting quotas for project 43c5da8fa182486990154b6f22539593. Resources: {'cores', 'instances', 'ram'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 17:28:02.664635 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-ced20b06-7c76-4da7-a86b-532e8f21e61d tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Getting quotas for user b4780bb497234a249b6d23afdab14370 and project 43c5da8fa182486990154b6f22539593. Resources: {'cores', 'instances', 'ram'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 17:28:02.675883 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-ced20b06-7c76-4da7-a86b-532e8f21e61d tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Going to run 1 instances... {{(pid=117910) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 17:28:02.678241 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-ced20b06-7c76-4da7-a86b-532e8f21e61d tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 937a33f5-bc7d-4e24-accc-b2f46fed62aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99870172-61a4-4218-9407-6a6da3fb5c83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117910) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 17:28:02.726962 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-ced20b06-7c76-4da7-a86b-532e8f21e61d tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.601224 May 23 17:28:02.732922 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 485/954] 10.222.0.46 () {60 vars in 1146 bytes} [Mon May 23 17:28:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 17:28:02.737969 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-76a14391-7fef-4408-8756-ff04646f9935 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:28:02.738550 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-76a14391-7fef-4408-8756-ff04646f9935 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 937a33f5-bc7d-4e24-accc-b2f46fed62aa] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:28:02.810492 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-76a14391-7fef-4408-8756-ff04646f9935 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:28:02.817387 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-76a14391-7fef-4408-8756-ff04646f9935 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa" status: 200 len: 1240 microversion: 2.1 time: 0.083277 May 23 17:28:02.818255 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 470/955] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:28:02 2022] GET /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:28:03.834430 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-87bf3220-efe7-467d-b0d4-ed6605a5f157 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:28:03.835268 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-87bf3220-efe7-467d-b0d4-ed6605a5f157 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 937a33f5-bc7d-4e24-accc-b2f46fed62aa] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:28:03.842998 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-87bf3220-efe7-467d-b0d4-ed6605a5f157 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:03.843446 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-87bf3220-efe7-467d-b0d4-ed6605a5f157 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:03.844189 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-87bf3220-efe7-467d-b0d4-ed6605a5f157 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:03.844665 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-87bf3220-efe7-467d-b0d4-ed6605a5f157 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:03.914100 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-87bf3220-efe7-467d-b0d4-ed6605a5f157 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:28:03.921957 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-87bf3220-efe7-467d-b0d4-ed6605a5f157 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa" status: 200 len: 1298 microversion: 2.1 time: 0.091404 May 23 17:28:03.922525 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 486/956] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:28:03 2022] GET /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa => generated 1298 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:28:04.609707 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8e3e0b79-ea7b-4d19-b167-849594f94105 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-416439087", "imageRef": "99870172-61a4-4218-9407-6a6da3fb5c83", "flavorRef": "452"}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:28:04.665380 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.network.neutron [None req-8e3e0b79-ea7b-4d19-b167-849594f94105 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] validate_networks() for None {{(pid=117909) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 17:28:04.941836 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-37a98539-3006-45b3-82be-a8f7b4a9e40a tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:28:04.942449 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-37a98539-3006-45b3-82be-a8f7b4a9e40a tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 937a33f5-bc7d-4e24-accc-b2f46fed62aa] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:28:04.949693 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-37a98539-3006-45b3-82be-a8f7b4a9e40a tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:04.950233 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-37a98539-3006-45b3-82be-a8f7b4a9e40a tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:04.951074 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-37a98539-3006-45b3-82be-a8f7b4a9e40a tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:04.951696 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-37a98539-3006-45b3-82be-a8f7b4a9e40a tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:05.045305 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-8e3e0b79-ea7b-4d19-b167-849594f94105 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Flavor limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 17:28:05.045911 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-8e3e0b79-ea7b-4d19-b167-849594f94105 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Image limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 17:28:05.046474 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-8e3e0b79-ea7b-4d19-b167-849594f94105 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Flavor pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 17:28:05.047122 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-8e3e0b79-ea7b-4d19-b167-849594f94105 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Image pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 17:28:05.047727 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-8e3e0b79-ea7b-4d19-b167-849594f94105 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 17:28:05.057083 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8e3e0b79-ea7b-4d19-b167-849594f94105 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:05.057571 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8e3e0b79-ea7b-4d19-b167-849594f94105 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:05.058383 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8e3e0b79-ea7b-4d19-b167-849594f94105 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:05.058829 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8e3e0b79-ea7b-4d19-b167-849594f94105 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:05.076832 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-8e3e0b79-ea7b-4d19-b167-849594f94105 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Getting quotas for project 67656c3c471246c0a78d649cec0f5794. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 17:28:05.081221 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-8e3e0b79-ea7b-4d19-b167-849594f94105 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Getting quotas for user d43e145f436b4b9a8e96796f65b1b114 and project 67656c3c471246c0a78d649cec0f5794. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 17:28:05.094314 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8e3e0b79-ea7b-4d19-b167-849594f94105 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Going to run 1 instances... {{(pid=117909) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 17:28:05.096639 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8e3e0b79-ea7b-4d19-b167-849594f94105 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] [instance: 89ff2539-7efa-49f2-a162-5530bfe35657] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99870172-61a4-4218-9407-6a6da3fb5c83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 17:28:05.141407 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8e3e0b79-ea7b-4d19-b167-849594f94105 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.535768 May 23 17:28:05.142226 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 471/957] 10.222.0.46 () {60 vars in 1146 bytes} [Mon May 23 17:28:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 17:28:05.151927 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-eb327c0b-5f20-4017-95f6-01bbc9adb095 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:28:05.152554 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-eb327c0b-5f20-4017-95f6-01bbc9adb095 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] [instance: 89ff2539-7efa-49f2-a162-5530bfe35657] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:28:05.224895 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-37a98539-3006-45b3-82be-a8f7b4a9e40a tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:28:05.234074 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-37a98539-3006-45b3-82be-a8f7b4a9e40a tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa" status: 200 len: 1366 microversion: 2.1 time: 0.296224 May 23 17:28:05.236194 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-eb327c0b-5f20-4017-95f6-01bbc9adb095 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43e145f436b4b9a8e96796f65b1b114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67656c3c471246c0a78d649cec0f5794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:28:05.239817 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 487/958] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:28:04 2022] GET /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa => generated 1366 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:28:05.245894 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-eb327c0b-5f20-4017-95f6-01bbc9adb095 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] 10.222.0.46 "GET /compute/v2.1/servers/89ff2539-7efa-49f2-a162-5530bfe35657" status: 200 len: 1214 microversion: 2.1 time: 0.097672 May 23 17:28:05.246471 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 472/959] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:28:05 2022] GET /compute/v2.1/servers/89ff2539-7efa-49f2-a162-5530bfe35657 => generated 1214 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:28:05.674976 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-c464b5b0-e713-40df-b956-8bc2487880a0 req-f55ac2ac-3c3e-4b91-8a01-c43aa0fad89d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "937a33f5-bc7d-4e24-accc-b2f46fed62aa", "tag": "4316d7e8-7afe-4701-bea9-f697c48dc5c4"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:28:05.687974 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-c464b5b0-e713-40df-b956-8bc2487880a0 req-f55ac2ac-3c3e-4b91-8a01-c43aa0fad89d service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:05.691844 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-c464b5b0-e713-40df-b956-8bc2487880a0 req-f55ac2ac-3c3e-4b91-8a01-c43aa0fad89d service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:05.712787 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-c464b5b0-e713-40df-b956-8bc2487880a0 req-f55ac2ac-3c3e-4b91-8a01-c43aa0fad89d service nova] Creating event network-changed:4316d7e8-7afe-4701-bea9-f697c48dc5c4 for instance 937a33f5-bc7d-4e24-accc-b2f46fed62aa on hv-cinder-84299 May 23 17:28:05.721078 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-c464b5b0-e713-40df-b956-8bc2487880a0 req-f55ac2ac-3c3e-4b91-8a01-c43aa0fad89d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055148 May 23 17:28:05.722160 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 488/960] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:28:06.263052 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2eec13b4-0ae7-416c-83e6-172c1106ddce tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:28:06.264296 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2eec13b4-0ae7-416c-83e6-172c1106ddce tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 937a33f5-bc7d-4e24-accc-b2f46fed62aa] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:28:06.265644 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c4ceb8cc-b68a-4c8f-b79f-aba6d6db8d2a tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:28:06.267062 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c4ceb8cc-b68a-4c8f-b79f-aba6d6db8d2a tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] [instance: 89ff2539-7efa-49f2-a162-5530bfe35657] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:28:06.272088 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2eec13b4-0ae7-416c-83e6-172c1106ddce tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:06.272549 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2eec13b4-0ae7-416c-83e6-172c1106ddce tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:06.273360 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2eec13b4-0ae7-416c-83e6-172c1106ddce tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:06.273800 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2eec13b4-0ae7-416c-83e6-172c1106ddce tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:06.274118 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c4ceb8cc-b68a-4c8f-b79f-aba6d6db8d2a tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:06.274638 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c4ceb8cc-b68a-4c8f-b79f-aba6d6db8d2a tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:06.275403 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c4ceb8cc-b68a-4c8f-b79f-aba6d6db8d2a tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:06.275834 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c4ceb8cc-b68a-4c8f-b79f-aba6d6db8d2a tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:06.365704 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-c4ceb8cc-b68a-4c8f-b79f-aba6d6db8d2a tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43e145f436b4b9a8e96796f65b1b114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67656c3c471246c0a78d649cec0f5794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:28:06.373728 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c4ceb8cc-b68a-4c8f-b79f-aba6d6db8d2a tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] 10.222.0.46 "GET /compute/v2.1/servers/89ff2539-7efa-49f2-a162-5530bfe35657" status: 200 len: 1272 microversion: 2.1 time: 0.113521 May 23 17:28:06.374391 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 489/961] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:28:06 2022] GET /compute/v2.1/servers/89ff2539-7efa-49f2-a162-5530bfe35657 => generated 1272 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:28:06.426555 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2eec13b4-0ae7-416c-83e6-172c1106ddce tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:28:06.434442 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2eec13b4-0ae7-416c-83e6-172c1106ddce tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa" status: 200 len: 1366 microversion: 2.1 time: 0.179133 May 23 17:28:06.435013 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 473/962] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:28:06 2022] GET /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:28:07.391860 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-5089f34a-9bad-4060-be73-827f7259a37d tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:28:07.392458 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-5089f34a-9bad-4060-be73-827f7259a37d tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] [instance: 89ff2539-7efa-49f2-a162-5530bfe35657] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:28:07.399810 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5089f34a-9bad-4060-be73-827f7259a37d tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:07.400220 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5089f34a-9bad-4060-be73-827f7259a37d tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:07.402220 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5089f34a-9bad-4060-be73-827f7259a37d tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:07.402844 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5089f34a-9bad-4060-be73-827f7259a37d tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:07.455522 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-707bd545-d55b-493b-bbfa-7cac8b172157 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:28:07.456249 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-707bd545-d55b-493b-bbfa-7cac8b172157 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 937a33f5-bc7d-4e24-accc-b2f46fed62aa] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:28:07.464882 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-707bd545-d55b-493b-bbfa-7cac8b172157 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:07.465339 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-707bd545-d55b-493b-bbfa-7cac8b172157 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:07.466135 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-707bd545-d55b-493b-bbfa-7cac8b172157 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:07.466577 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-707bd545-d55b-493b-bbfa-7cac8b172157 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:07.476408 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-5089f34a-9bad-4060-be73-827f7259a37d tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43e145f436b4b9a8e96796f65b1b114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67656c3c471246c0a78d649cec0f5794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:28:07.488980 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-5089f34a-9bad-4060-be73-827f7259a37d tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] 10.222.0.46 "GET /compute/v2.1/servers/89ff2539-7efa-49f2-a162-5530bfe35657" status: 200 len: 1272 microversion: 2.1 time: 0.100953 May 23 17:28:07.490170 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 490/963] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:28:07 2022] GET /compute/v2.1/servers/89ff2539-7efa-49f2-a162-5530bfe35657 => generated 1272 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:28:07.627989 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-707bd545-d55b-493b-bbfa-7cac8b172157 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:28:07.636179 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-707bd545-d55b-493b-bbfa-7cac8b172157 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa" status: 200 len: 1366 microversion: 2.1 time: 0.184528 May 23 17:28:07.645698 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 474/964] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:28:07 2022] GET /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:28:08.282891 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-44180815-db4f-44e1-a9dc-00ac81031dab req-3b16cc24-d780-44dc-a27b-aaff91c75b5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89ff2539-7efa-49f2-a162-5530bfe35657", "tag": "2802c8b3-532e-4d2b-b778-cff1dfa20afa"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:28:08.292671 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-44180815-db4f-44e1-a9dc-00ac81031dab req-3b16cc24-d780-44dc-a27b-aaff91c75b5a service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:08.294107 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-44180815-db4f-44e1-a9dc-00ac81031dab req-3b16cc24-d780-44dc-a27b-aaff91c75b5a service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:08.306802 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-44180815-db4f-44e1-a9dc-00ac81031dab req-3b16cc24-d780-44dc-a27b-aaff91c75b5a service nova] Creating event network-changed:2802c8b3-532e-4d2b-b778-cff1dfa20afa for instance 89ff2539-7efa-49f2-a162-5530bfe35657 on hv-cinder-84299 May 23 17:28:08.312270 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-44180815-db4f-44e1-a9dc-00ac81031dab req-3b16cc24-d780-44dc-a27b-aaff91c75b5a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039027 May 23 17:28:08.313120 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 491/965] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:28:08.506498 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b3850dd9-ee1a-45a4-bf8f-9f068f38412b tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:28:08.507150 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b3850dd9-ee1a-45a4-bf8f-9f068f38412b tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] [instance: 89ff2539-7efa-49f2-a162-5530bfe35657] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:28:08.513954 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b3850dd9-ee1a-45a4-bf8f-9f068f38412b tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:08.514402 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b3850dd9-ee1a-45a4-bf8f-9f068f38412b tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:08.515409 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b3850dd9-ee1a-45a4-bf8f-9f068f38412b tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:08.515816 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b3850dd9-ee1a-45a4-bf8f-9f068f38412b tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:08.654642 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b828e39c-30a7-46e3-af87-aec5db164344 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:28:08.656006 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-b828e39c-30a7-46e3-af87-aec5db164344 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 937a33f5-bc7d-4e24-accc-b2f46fed62aa] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:28:08.662467 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b828e39c-30a7-46e3-af87-aec5db164344 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:08.663128 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b828e39c-30a7-46e3-af87-aec5db164344 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:08.663894 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b828e39c-30a7-46e3-af87-aec5db164344 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:08.664675 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b828e39c-30a7-46e3-af87-aec5db164344 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:08.667269 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b3850dd9-ee1a-45a4-bf8f-9f068f38412b tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43e145f436b4b9a8e96796f65b1b114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67656c3c471246c0a78d649cec0f5794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:28:08.676402 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b3850dd9-ee1a-45a4-bf8f-9f068f38412b tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] 10.222.0.46 "GET /compute/v2.1/servers/89ff2539-7efa-49f2-a162-5530bfe35657" status: 200 len: 1314 microversion: 2.1 time: 0.173965 May 23 17:28:08.677311 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 475/966] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:28:08 2022] GET /compute/v2.1/servers/89ff2539-7efa-49f2-a162-5530bfe35657 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:28:08.795302 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b828e39c-30a7-46e3-af87-aec5db164344 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:28:08.803713 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b828e39c-30a7-46e3-af87-aec5db164344 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa" status: 200 len: 1366 microversion: 2.1 time: 0.154140 May 23 17:28:08.804358 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 492/967] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:28:08 2022] GET /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:28:09.694314 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8f261849-72ae-41b6-8fed-8035cd92d39f tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:28:09.694994 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8f261849-72ae-41b6-8fed-8035cd92d39f tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] [instance: 89ff2539-7efa-49f2-a162-5530bfe35657] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:28:09.704500 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8f261849-72ae-41b6-8fed-8035cd92d39f tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:09.705036 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8f261849-72ae-41b6-8fed-8035cd92d39f tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:09.706199 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8f261849-72ae-41b6-8fed-8035cd92d39f tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:09.706823 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8f261849-72ae-41b6-8fed-8035cd92d39f tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:09.820939 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-3cfeab6a-fa25-46c4-9e61-d6e81ca7ec98 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:28:09.821550 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-3cfeab6a-fa25-46c4-9e61-d6e81ca7ec98 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 937a33f5-bc7d-4e24-accc-b2f46fed62aa] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:28:09.828131 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3cfeab6a-fa25-46c4-9e61-d6e81ca7ec98 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:09.828635 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3cfeab6a-fa25-46c4-9e61-d6e81ca7ec98 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:09.829393 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3cfeab6a-fa25-46c4-9e61-d6e81ca7ec98 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:09.829812 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3cfeab6a-fa25-46c4-9e61-d6e81ca7ec98 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:09.837146 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8f261849-72ae-41b6-8fed-8035cd92d39f tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43e145f436b4b9a8e96796f65b1b114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67656c3c471246c0a78d649cec0f5794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:28:09.844901 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8f261849-72ae-41b6-8fed-8035cd92d39f tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] 10.222.0.46 "GET /compute/v2.1/servers/89ff2539-7efa-49f2-a162-5530bfe35657" status: 200 len: 1314 microversion: 2.1 time: 0.155335 May 23 17:28:09.845458 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 476/968] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:28:09 2022] GET /compute/v2.1/servers/89ff2539-7efa-49f2-a162-5530bfe35657 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:28:09.971191 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-3cfeab6a-fa25-46c4-9e61-d6e81ca7ec98 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:28:09.978887 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-3cfeab6a-fa25-46c4-9e61-d6e81ca7ec98 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa" status: 200 len: 1366 microversion: 2.1 time: 0.162182 May 23 17:28:09.979458 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 493/969] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:28:09 2022] GET /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:28:10.638096 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-5020d489-2d8d-46d0-8d17-42b1b39fa898 req-1f18fb3e-b629-423b-af45-2c12b97eade4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "937a33f5-bc7d-4e24-accc-b2f46fed62aa", "name": "network-vif-plugged", "status": "completed", "tag": "4316d7e8-7afe-4701-bea9-f697c48dc5c4"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:28:10.647208 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-5020d489-2d8d-46d0-8d17-42b1b39fa898 req-1f18fb3e-b629-423b-af45-2c12b97eade4 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:10.647738 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-5020d489-2d8d-46d0-8d17-42b1b39fa898 req-1f18fb3e-b629-423b-af45-2c12b97eade4 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:10.659320 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-5020d489-2d8d-46d0-8d17-42b1b39fa898 req-1f18fb3e-b629-423b-af45-2c12b97eade4 service nova] Creating event network-vif-plugged:4316d7e8-7afe-4701-bea9-f697c48dc5c4 for instance 937a33f5-bc7d-4e24-accc-b2f46fed62aa on hv-cinder-84299 May 23 17:28:10.664439 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-5020d489-2d8d-46d0-8d17-42b1b39fa898 req-1f18fb3e-b629-423b-af45-2c12b97eade4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030890 May 23 17:28:10.665078 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 477/970] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 17:28:10.863974 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-5a8ad917-7933-402b-825a-f87ce1d8323d tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:28:10.864557 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-5a8ad917-7933-402b-825a-f87ce1d8323d tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] [instance: 89ff2539-7efa-49f2-a162-5530bfe35657] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:28:10.872085 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5a8ad917-7933-402b-825a-f87ce1d8323d tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:10.872523 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5a8ad917-7933-402b-825a-f87ce1d8323d tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:10.873368 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5a8ad917-7933-402b-825a-f87ce1d8323d tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:10.873790 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5a8ad917-7933-402b-825a-f87ce1d8323d tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:10.997062 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-34488a5a-aebd-4316-b156-bcb1226874e2 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:28:11.000125 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-34488a5a-aebd-4316-b156-bcb1226874e2 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 937a33f5-bc7d-4e24-accc-b2f46fed62aa] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:28:11.006828 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-34488a5a-aebd-4316-b156-bcb1226874e2 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:11.006990 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-5a8ad917-7933-402b-825a-f87ce1d8323d tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43e145f436b4b9a8e96796f65b1b114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67656c3c471246c0a78d649cec0f5794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:28:11.007687 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-34488a5a-aebd-4316-b156-bcb1226874e2 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:11.008746 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-34488a5a-aebd-4316-b156-bcb1226874e2 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:11.009423 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-34488a5a-aebd-4316-b156-bcb1226874e2 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:11.015226 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-5a8ad917-7933-402b-825a-f87ce1d8323d tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] 10.222.0.46 "GET /compute/v2.1/servers/89ff2539-7efa-49f2-a162-5530bfe35657" status: 200 len: 1314 microversion: 2.1 time: 0.156186 May 23 17:28:11.015840 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 494/971] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:28:10 2022] GET /compute/v2.1/servers/89ff2539-7efa-49f2-a162-5530bfe35657 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:28:11.143741 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-34488a5a-aebd-4316-b156-bcb1226874e2 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:28:11.151707 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-34488a5a-aebd-4316-b156-bcb1226874e2 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa" status: 200 len: 1366 microversion: 2.1 time: 0.159789 May 23 17:28:11.152282 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 478/972] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:28:10 2022] GET /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:28:12.036567 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-dc30a2ab-3914-45de-a463-972b9f8a872e tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:28:12.037593 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-dc30a2ab-3914-45de-a463-972b9f8a872e tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] [instance: 89ff2539-7efa-49f2-a162-5530bfe35657] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:28:12.045128 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-dc30a2ab-3914-45de-a463-972b9f8a872e tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:12.045577 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-dc30a2ab-3914-45de-a463-972b9f8a872e tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:12.046336 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-dc30a2ab-3914-45de-a463-972b9f8a872e tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:12.046772 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-dc30a2ab-3914-45de-a463-972b9f8a872e tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:12.169822 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5cbe4806-746d-42b6-8f65-177a38ceb15a tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:28:12.170610 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5cbe4806-746d-42b6-8f65-177a38ceb15a tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 937a33f5-bc7d-4e24-accc-b2f46fed62aa] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:28:12.178552 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5cbe4806-746d-42b6-8f65-177a38ceb15a tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:12.179255 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5cbe4806-746d-42b6-8f65-177a38ceb15a tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:12.180266 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5cbe4806-746d-42b6-8f65-177a38ceb15a tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:12.180854 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5cbe4806-746d-42b6-8f65-177a38ceb15a tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:12.184537 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-dc30a2ab-3914-45de-a463-972b9f8a872e tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43e145f436b4b9a8e96796f65b1b114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67656c3c471246c0a78d649cec0f5794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:28:12.192862 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-dc30a2ab-3914-45de-a463-972b9f8a872e tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] 10.222.0.46 "GET /compute/v2.1/servers/89ff2539-7efa-49f2-a162-5530bfe35657" status: 200 len: 1314 microversion: 2.1 time: 0.162637 May 23 17:28:12.193859 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 495/973] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:28:12 2022] GET /compute/v2.1/servers/89ff2539-7efa-49f2-a162-5530bfe35657 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:28:12.322911 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5cbe4806-746d-42b6-8f65-177a38ceb15a tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:28:12.330747 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5cbe4806-746d-42b6-8f65-177a38ceb15a tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa" status: 200 len: 1366 microversion: 2.1 time: 0.165468 May 23 17:28:12.331359 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 479/974] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:28:12 2022] GET /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:28:12.685884 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-b8569109-c342-426e-b14b-2174c18e9506 req-50119157-22c3-4897-a879-ca8fe2beb079 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89ff2539-7efa-49f2-a162-5530bfe35657", "name": "network-vif-plugged", "status": "completed", "tag": "2802c8b3-532e-4d2b-b778-cff1dfa20afa"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:28:12.689531 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=2 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:28:12.690312 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=6 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:28:12.697161 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-b8569109-c342-426e-b14b-2174c18e9506 req-50119157-22c3-4897-a879-ca8fe2beb079 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:12.697609 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-b8569109-c342-426e-b14b-2174c18e9506 req-50119157-22c3-4897-a879-ca8fe2beb079 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:12.708907 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-b8569109-c342-426e-b14b-2174c18e9506 req-50119157-22c3-4897-a879-ca8fe2beb079 service nova] Creating event network-vif-plugged:2802c8b3-532e-4d2b-b778-cff1dfa20afa for instance 89ff2539-7efa-49f2-a162-5530bfe35657 on hv-cinder-84299 May 23 17:28:12.713945 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-b8569109-c342-426e-b14b-2174c18e9506 req-50119157-22c3-4897-a879-ca8fe2beb079 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031797 May 23 17:28:12.714712 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 496/975] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:28:13.213457 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ea8bf0a7-73c5-4dd8-86fe-9d9d29435d70 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:28:13.214866 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ea8bf0a7-73c5-4dd8-86fe-9d9d29435d70 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] [instance: 89ff2539-7efa-49f2-a162-5530bfe35657] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:28:13.223264 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ea8bf0a7-73c5-4dd8-86fe-9d9d29435d70 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:13.223888 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ea8bf0a7-73c5-4dd8-86fe-9d9d29435d70 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:13.224894 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ea8bf0a7-73c5-4dd8-86fe-9d9d29435d70 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:13.225433 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ea8bf0a7-73c5-4dd8-86fe-9d9d29435d70 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:13.348018 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-8019b2ca-6137-4ee6-91cb-288e3d5e3c59 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:28:13.348739 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-8019b2ca-6137-4ee6-91cb-288e3d5e3c59 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 937a33f5-bc7d-4e24-accc-b2f46fed62aa] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:28:13.355989 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8019b2ca-6137-4ee6-91cb-288e3d5e3c59 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:13.356427 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8019b2ca-6137-4ee6-91cb-288e3d5e3c59 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:13.357233 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8019b2ca-6137-4ee6-91cb-288e3d5e3c59 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:13.357666 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8019b2ca-6137-4ee6-91cb-288e3d5e3c59 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:13.362193 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ea8bf0a7-73c5-4dd8-86fe-9d9d29435d70 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43e145f436b4b9a8e96796f65b1b114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67656c3c471246c0a78d649cec0f5794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:28:13.370244 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ea8bf0a7-73c5-4dd8-86fe-9d9d29435d70 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] 10.222.0.46 "GET /compute/v2.1/servers/89ff2539-7efa-49f2-a162-5530bfe35657" status: 200 len: 1314 microversion: 2.1 time: 0.162869 May 23 17:28:13.370831 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 480/976] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:28:13 2022] GET /compute/v2.1/servers/89ff2539-7efa-49f2-a162-5530bfe35657 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:28:13.488356 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-8019b2ca-6137-4ee6-91cb-288e3d5e3c59 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:28:13.491172 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:28:13.497985 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-8019b2ca-6137-4ee6-91cb-288e3d5e3c59 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa" status: 200 len: 1557 microversion: 2.1 time: 0.154255 May 23 17:28:13.498575 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 497/977] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:28:13 2022] GET /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:28:13.514654 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2d6015a9-3bbd-4cd1-b5fd-194bac9fbc30 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:28:13.515151 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2d6015a9-3bbd-4cd1-b5fd-194bac9fbc30 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 937a33f5-bc7d-4e24-accc-b2f46fed62aa] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:28:13.521532 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2d6015a9-3bbd-4cd1-b5fd-194bac9fbc30 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:13.521984 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2d6015a9-3bbd-4cd1-b5fd-194bac9fbc30 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:13.522754 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2d6015a9-3bbd-4cd1-b5fd-194bac9fbc30 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:13.523265 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2d6015a9-3bbd-4cd1-b5fd-194bac9fbc30 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:13.612646 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2d6015a9-3bbd-4cd1-b5fd-194bac9fbc30 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102254 May 23 17:28:13.613280 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 481/978] 10.222.0.46 () {58 vars in 1274 bytes} [Mon May 23 17:28:13 2022] GET /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:28:14.388691 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-ad159510-36e9-4b2d-9d2a-d2ec75ff2ffe tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:28:14.389284 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-ad159510-36e9-4b2d-9d2a-d2ec75ff2ffe tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] [instance: 89ff2539-7efa-49f2-a162-5530bfe35657] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:28:14.396477 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ad159510-36e9-4b2d-9d2a-d2ec75ff2ffe tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:14.396951 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ad159510-36e9-4b2d-9d2a-d2ec75ff2ffe tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:14.397764 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ad159510-36e9-4b2d-9d2a-d2ec75ff2ffe tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:14.398637 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ad159510-36e9-4b2d-9d2a-d2ec75ff2ffe tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:14.874770 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ad159510-36e9-4b2d-9d2a-d2ec75ff2ffe tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43e145f436b4b9a8e96796f65b1b114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67656c3c471246c0a78d649cec0f5794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:28:14.883874 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-ad159510-36e9-4b2d-9d2a-d2ec75ff2ffe tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] 10.222.0.46 "GET /compute/v2.1/servers/89ff2539-7efa-49f2-a162-5530bfe35657" status: 200 len: 1463 microversion: 2.1 time: 0.500471 May 23 17:28:14.884458 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 498/979] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:28:14 2022] GET /compute/v2.1/servers/89ff2539-7efa-49f2-a162-5530bfe35657 => generated 1463 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:28:14.924543 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-43061196-dd31-4dc4-b4a6-4ee9adc8c236 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:28:14.925153 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-43061196-dd31-4dc4-b4a6-4ee9adc8c236 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] [instance: 89ff2539-7efa-49f2-a162-5530bfe35657] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:28:14.933574 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-43061196-dd31-4dc4-b4a6-4ee9adc8c236 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:14.934021 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-43061196-dd31-4dc4-b4a6-4ee9adc8c236 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:14.934789 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-43061196-dd31-4dc4-b4a6-4ee9adc8c236 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:14.935355 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-43061196-dd31-4dc4-b4a6-4ee9adc8c236 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:14.960949 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-43061196-dd31-4dc4-b4a6-4ee9adc8c236 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] [instance: 89ff2539-7efa-49f2-a162-5530bfe35657] Going to try to terminate instance {{(pid=117910) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 17:28:15.050650 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-7c906336-0f26-4d38-a9c5-b80df6b839fe req-362aed92-6c71-4582-af0e-11fe2c43ad17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "937a33f5-bc7d-4e24-accc-b2f46fed62aa", "tag": "4316d7e8-7afe-4701-bea9-f697c48dc5c4"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:28:15.059290 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-7c906336-0f26-4d38-a9c5-b80df6b839fe req-362aed92-6c71-4582-af0e-11fe2c43ad17 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:15.059968 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-7c906336-0f26-4d38-a9c5-b80df6b839fe req-362aed92-6c71-4582-af0e-11fe2c43ad17 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:15.072702 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-43061196-dd31-4dc4-b4a6-4ee9adc8c236 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] 10.222.0.46 "DELETE /compute/v2.1/servers/89ff2539-7efa-49f2-a162-5530bfe35657" status: 204 len: 0 microversion: 2.1 time: 0.149274 May 23 17:28:15.074227 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=2 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:28:15.076722 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 499/980] 10.222.0.46 () {58 vars in 1238 bytes} [Mon May 23 17:28:14 2022] DELETE /compute/v2.1/servers/89ff2539-7efa-49f2-a162-5530bfe35657 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 23 17:28:15.081279 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-7c906336-0f26-4d38-a9c5-b80df6b839fe req-362aed92-6c71-4582-af0e-11fe2c43ad17 service nova] Creating event network-changed:4316d7e8-7afe-4701-bea9-f697c48dc5c4 for instance 937a33f5-bc7d-4e24-accc-b2f46fed62aa on hv-cinder-84299 May 23 17:28:15.084081 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-bd1925e4-664b-42d3-a196-1d9d43a3275a tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:28:15.084904 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-bd1925e4-664b-42d3-a196-1d9d43a3275a tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] [instance: 89ff2539-7efa-49f2-a162-5530bfe35657] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:28:15.086942 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-7c906336-0f26-4d38-a9c5-b80df6b839fe req-362aed92-6c71-4582-af0e-11fe2c43ad17 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.205418 May 23 17:28:15.087632 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 482/981] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:28:15.092008 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bd1925e4-664b-42d3-a196-1d9d43a3275a tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:15.092552 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bd1925e4-664b-42d3-a196-1d9d43a3275a tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:15.093462 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bd1925e4-664b-42d3-a196-1d9d43a3275a tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:15.093971 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bd1925e4-664b-42d3-a196-1d9d43a3275a tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:15.223169 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-bd1925e4-664b-42d3-a196-1d9d43a3275a tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43e145f436b4b9a8e96796f65b1b114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67656c3c471246c0a78d649cec0f5794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:28:15.231098 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-bd1925e4-664b-42d3-a196-1d9d43a3275a tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] 10.222.0.46 "GET /compute/v2.1/servers/89ff2539-7efa-49f2-a162-5530bfe35657" status: 200 len: 1469 microversion: 2.1 time: 0.151395 May 23 17:28:15.231656 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 500/982] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:28:15 2022] GET /compute/v2.1/servers/89ff2539-7efa-49f2-a162-5530bfe35657 => generated 1469 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:28:16.245840 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=14 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:28:16.250977 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1383d94f-2d22-4f8d-a9dd-4b774933ee07 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:28:16.251686 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1383d94f-2d22-4f8d-a9dd-4b774933ee07 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] [instance: 89ff2539-7efa-49f2-a162-5530bfe35657] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:28:16.258641 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1383d94f-2d22-4f8d-a9dd-4b774933ee07 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:16.259104 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1383d94f-2d22-4f8d-a9dd-4b774933ee07 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:16.259874 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1383d94f-2d22-4f8d-a9dd-4b774933ee07 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:16.260313 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1383d94f-2d22-4f8d-a9dd-4b774933ee07 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:16.423957 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1383d94f-2d22-4f8d-a9dd-4b774933ee07 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43e145f436b4b9a8e96796f65b1b114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67656c3c471246c0a78d649cec0f5794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:28:16.432767 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1383d94f-2d22-4f8d-a9dd-4b774933ee07 tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] 10.222.0.46 "GET /compute/v2.1/servers/89ff2539-7efa-49f2-a162-5530bfe35657" status: 200 len: 1469 microversion: 2.1 time: 0.187909 May 23 17:28:16.433363 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 483/983] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:28:16 2022] GET /compute/v2.1/servers/89ff2539-7efa-49f2-a162-5530bfe35657 => generated 1469 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:28:17.105348 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-b655d391-7deb-4688-9587-37e1ebdb9497 req-ab344278-3dae-44c6-b30a-5302d3221292 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89ff2539-7efa-49f2-a162-5530bfe35657", "name": "network-vif-deleted", "tag": "2802c8b3-532e-4d2b-b778-cff1dfa20afa"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:28:17.117335 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-b655d391-7deb-4688-9587-37e1ebdb9497 req-ab344278-3dae-44c6-b30a-5302d3221292 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:17.117785 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-b655d391-7deb-4688-9587-37e1ebdb9497 req-ab344278-3dae-44c6-b30a-5302d3221292 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:17.130192 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-b655d391-7deb-4688-9587-37e1ebdb9497 req-ab344278-3dae-44c6-b30a-5302d3221292 service nova] Creating event network-vif-deleted:2802c8b3-532e-4d2b-b778-cff1dfa20afa for instance 89ff2539-7efa-49f2-a162-5530bfe35657 on hv-cinder-84299 May 23 17:28:17.135035 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-b655d391-7deb-4688-9587-37e1ebdb9497 req-ab344278-3dae-44c6-b30a-5302d3221292 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034793 May 23 17:28:17.135609 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 501/984] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:28:17.451033 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0b0779f6-b97a-4275-b6ba-5993d413cb5e tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:28:17.451763 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0b0779f6-b97a-4275-b6ba-5993d413cb5e tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] [instance: 89ff2539-7efa-49f2-a162-5530bfe35657] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:28:17.458770 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0b0779f6-b97a-4275-b6ba-5993d413cb5e tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:17.459226 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0b0779f6-b97a-4275-b6ba-5993d413cb5e tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:17.459995 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0b0779f6-b97a-4275-b6ba-5993d413cb5e tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:17.460433 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0b0779f6-b97a-4275-b6ba-5993d413cb5e tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:17.474365 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-0b0779f6-b97a-4275-b6ba-5993d413cb5e tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] HTTP exception thrown: Instance 89ff2539-7efa-49f2-a162-5530bfe35657 could not be found. May 23 17:28:17.476045 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0b0779f6-b97a-4275-b6ba-5993d413cb5e tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Request method failure captured: May 23 17:28:17.476045 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: request: GET /compute/v2.1/servers/89ff2539-7efa-49f2-a162-5530bfe35657 HTTP/1.1 May 23 17:28:17.476045 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept: application/json May 23 17:28:17.476045 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity May 23 17:28:17.476045 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Connection: close May 23 17:28:17.476045 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Length: 0 May 23 17:28:17.476045 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Type: application/json May 23 17:28:17.476045 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Host: 10.222.0.46 May 23 17:28:17.476045 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None May 23 17:28:17.476045 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.9 May 23 17:28:17.476045 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABii8QjMH63JzWVbRExwZBpZG49knXMD9v0N9clmhNXJ7MmhJ6T4nRu9CRR2uT9Y8luxPEnGGn24q4psd700F3Ax2ptJuO3DV84alA0F8XVGoB8fkzTtTdW1forLvwd33NnZqGVq9AZPoHRTCU1B6m6ymI2eEVb9C8-iVAj_aj4HNLy4n4 May 23 17:28:17.476045 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Id: None May 23 17:28:17.476045 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Name: None May 23 17:28:17.476045 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed May 23 17:28:17.476045 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True May 23 17:28:17.476045 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default May 23 17:28:17.476045 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default May 23 17:28:17.476045 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Id: 67656c3c471246c0a78d649cec0f5794 May 23 17:28:17.476045 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-VolumesNegativeTest-1494063797 May 23 17:28:17.476045 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Role: reader,member May 23 17:28:17.476045 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Roles: reader,member May 23 17:28:17.477792 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/67656c3c471246c0a78d649cec0f5794"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/67656c3c471246c0a78d649cec0f5794"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/67656c3c471246c0a78d649cec0f5794"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_67656c3c471246c0a78d649cec0f5794"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:28:17.477792 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-VolumesNegativeTest-1494063797 May 23 17:28:17.477792 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 67656c3c471246c0a78d649cec0f5794 May 23 17:28:17.477792 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-VolumesNegativeTest-1494063797 May 23 17:28:17.477792 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User: tempest-VolumesNegativeTest-1494063797-project May 23 17:28:17.477792 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default May 23 17:28:17.477792 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default May 23 17:28:17.477792 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Id: d43e145f436b4b9a8e96796f65b1b114 May 23 17:28:17.477792 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-VolumesNegativeTest-1494063797-project May 23 17:28:17.477792 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: method: > May 23 17:28:17.477792 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: exception: Instance 89ff2539-7efa-49f2-a162-5530bfe35657 could not be found. May 23 17:28:17.477792 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: action_args: {'id': '89ff2539-7efa-49f2-a162-5530bfe35657'} May 23 17:28:17.478709 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:28:17.478709 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:28:17.478709 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:28:17.478709 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:28:17.478709 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:28:17.478709 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:28:17.478709 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:28:17.478709 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:28:17.478709 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:28:17.478709 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:28:17.478709 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89ff2539-7efa-49f2-a162-5530bfe35657 could not be found. May 23 17:28:17.478709 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:28:17.478709 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:28:17.478709 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:28:17.478709 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:28:17.478709 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:28:17.478709 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:28:17.478709 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:28:17.478709 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:28:17.478709 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:28:17.480338 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:28:17.480338 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 17:28:17.480338 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 17:28:17.480338 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:28:17.480338 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:28:17.480338 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:28:17.480338 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:28:17.480338 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89ff2539-7efa-49f2-a162-5530bfe35657 could not be found. May 23 17:28:17.480338 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:28:17.480338 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:28:17.480338 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:28:17.480338 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:28:17.480338 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:28:17.480338 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:28:17.480338 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:28:17.480338 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:28:17.480338 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89ff2539-7efa-49f2-a162-5530bfe35657 could not be found. May 23 17:28:17.480338 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:28:17.481904 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0b0779f6-b97a-4275-b6ba-5993d413cb5e tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] Returning 404 to user: Instance 89ff2539-7efa-49f2-a162-5530bfe35657 could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:28:17.481904 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0b0779f6-b97a-4275-b6ba-5993d413cb5e tempest-VolumesNegativeTest-1494063797 tempest-VolumesNegativeTest-1494063797-project] 10.222.0.46 "GET /compute/v2.1/servers/89ff2539-7efa-49f2-a162-5530bfe35657" status: 404 len: 111 microversion: 2.1 time: 0.030596 May 23 17:28:17.481904 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 484/985] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:28:17 2022] GET /compute/v2.1/servers/89ff2539-7efa-49f2-a162-5530bfe35657 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:28:46.551613 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-de478e38-3834-42db-a027-594cbacf9aed tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:28:46.552547 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-de478e38-3834-42db-a027-594cbacf9aed tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 937a33f5-bc7d-4e24-accc-b2f46fed62aa] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:28:46.555972 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:28:46.557070 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:28:46.568748 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-de478e38-3834-42db-a027-594cbacf9aed tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:46.569486 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-de478e38-3834-42db-a027-594cbacf9aed tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:46.570578 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-de478e38-3834-42db-a027-594cbacf9aed tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:46.571025 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-de478e38-3834-42db-a027-594cbacf9aed tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:46.596901 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-de478e38-3834-42db-a027-594cbacf9aed tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa/ips" status: 200 len: 150 microversion: 2.1 time: 0.052841 May 23 17:28:46.597458 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 502/986] 10.222.0.46 () {58 vars in 1247 bytes} [Mon May 23 17:28:46 2022] GET /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa/ips => generated 150 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:28:47.935636 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ff065dd3-29fc-48b2-9376-204d8f9b2dba tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83cad461-98d9-4efd-8f95-b5d41f77f170"}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:28:47.936759 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ff065dd3-29fc-48b2-9376-204d8f9b2dba tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 937a33f5-bc7d-4e24-accc-b2f46fed62aa] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:28:47.939410 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=4 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:28:47.940085 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:28:47.946843 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ff065dd3-29fc-48b2-9376-204d8f9b2dba tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:47.947301 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ff065dd3-29fc-48b2-9376-204d8f9b2dba tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:47.948082 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ff065dd3-29fc-48b2-9376-204d8f9b2dba tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:47.948520 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ff065dd3-29fc-48b2-9376-204d8f9b2dba tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:48.199593 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ff065dd3-29fc-48b2-9376-204d8f9b2dba tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "POST /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267995 May 23 17:28:48.200202 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 485/987] 10.222.0.46 () {60 vars in 1322 bytes} [Mon May 23 17:28:47 2022] POST /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:28:54.797137 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-344948e5-9079-42aa-9478-4670bf5cef9d tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:28:54.797685 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-344948e5-9079-42aa-9478-4670bf5cef9d tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 937a33f5-bc7d-4e24-accc-b2f46fed62aa] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:28:54.804418 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-344948e5-9079-42aa-9478-4670bf5cef9d tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:54.804913 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-344948e5-9079-42aa-9478-4670bf5cef9d tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:54.805689 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-344948e5-9079-42aa-9478-4670bf5cef9d tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:54.806125 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-344948e5-9079-42aa-9478-4670bf5cef9d tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:54.889017 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.objects.instance [None req-344948e5-9079-42aa-9478-4670bf5cef9d tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lazy-loading 'services' on Instance uuid 937a33f5-bc7d-4e24-accc-b2f46fed62aa {{(pid=117910) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 17:28:54.967455 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-344948e5-9079-42aa-9478-4670bf5cef9d tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "DELETE /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa/os-volume_attachments/83cad461-98d9-4efd-8f95-b5d41f77f170" status: 202 len: 0 microversion: 2.1 time: 0.174231 May 23 17:28:54.968040 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 503/988] 10.222.0.46 () {58 vars in 1415 bytes} [Mon May 23 17:28:54 2022] DELETE /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa/os-volume_attachments/83cad461-98d9-4efd-8f95-b5d41f77f170 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 17:28:54.978136 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-64a4e38c-1697-4cc6-9574-58f840aacfbb tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:28:54.979211 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-64a4e38c-1697-4cc6-9574-58f840aacfbb tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 937a33f5-bc7d-4e24-accc-b2f46fed62aa] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:28:54.986289 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-64a4e38c-1697-4cc6-9574-58f840aacfbb tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:54.986844 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-64a4e38c-1697-4cc6-9574-58f840aacfbb tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:54.987892 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-64a4e38c-1697-4cc6-9574-58f840aacfbb tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:54.988210 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-64a4e38c-1697-4cc6-9574-58f840aacfbb tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:55.020260 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-64a4e38c-1697-4cc6-9574-58f840aacfbb tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046959 May 23 17:28:55.020879 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 486/989] 10.222.0.46 () {58 vars in 1301 bytes} [Mon May 23 17:28:54 2022] GET /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:28:56.036920 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d8f03208-4780-4a5b-9fb4-3fc799c566d9 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:28:56.038655 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d8f03208-4780-4a5b-9fb4-3fc799c566d9 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 937a33f5-bc7d-4e24-accc-b2f46fed62aa] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:28:56.049568 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d8f03208-4780-4a5b-9fb4-3fc799c566d9 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:56.050312 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d8f03208-4780-4a5b-9fb4-3fc799c566d9 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:56.051673 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d8f03208-4780-4a5b-9fb4-3fc799c566d9 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:56.052292 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d8f03208-4780-4a5b-9fb4-3fc799c566d9 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:56.084701 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d8f03208-4780-4a5b-9fb4-3fc799c566d9 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055354 May 23 17:28:56.085230 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 504/990] 10.222.0.46 () {58 vars in 1301 bytes} [Mon May 23 17:28:56 2022] GET /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 17:28:56.148262 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a7dffa7f-05dc-4096-9998-cd726eeaa12f tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:28:56.148874 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a7dffa7f-05dc-4096-9998-cd726eeaa12f tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 937a33f5-bc7d-4e24-accc-b2f46fed62aa] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:28:56.155893 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a7dffa7f-05dc-4096-9998-cd726eeaa12f tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:56.156393 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a7dffa7f-05dc-4096-9998-cd726eeaa12f tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:56.157252 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a7dffa7f-05dc-4096-9998-cd726eeaa12f tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:56.157687 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a7dffa7f-05dc-4096-9998-cd726eeaa12f tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:56.186640 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a7dffa7f-05dc-4096-9998-cd726eeaa12f tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 937a33f5-bc7d-4e24-accc-b2f46fed62aa] Going to try to terminate instance {{(pid=117909) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 17:28:56.271278 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a7dffa7f-05dc-4096-9998-cd726eeaa12f tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "DELETE /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa" status: 204 len: 0 microversion: 2.1 time: 0.128181 May 23 17:28:56.272149 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 487/991] 10.222.0.46 () {58 vars in 1238 bytes} [Mon May 23 17:28:56 2022] DELETE /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 17:28:56.280405 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-6b222e6b-8a16-413b-8220-f20f844e4aca tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:28:56.281047 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-6b222e6b-8a16-413b-8220-f20f844e4aca tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 937a33f5-bc7d-4e24-accc-b2f46fed62aa] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:28:56.287357 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6b222e6b-8a16-413b-8220-f20f844e4aca tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:56.287817 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6b222e6b-8a16-413b-8220-f20f844e4aca tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:56.288570 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6b222e6b-8a16-413b-8220-f20f844e4aca tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:56.289032 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6b222e6b-8a16-413b-8220-f20f844e4aca tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:56.419225 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-6b222e6b-8a16-413b-8220-f20f844e4aca tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:28:56.429153 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-6b222e6b-8a16-413b-8220-f20f844e4aca tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa" status: 200 len: 1681 microversion: 2.1 time: 0.152333 May 23 17:28:56.429898 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 505/992] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:28:56 2022] GET /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:28:57.457424 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1bf2ae2d-1d12-4100-a500-74ef24be97f3 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:28:57.458635 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1bf2ae2d-1d12-4100-a500-74ef24be97f3 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 937a33f5-bc7d-4e24-accc-b2f46fed62aa] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:28:57.468868 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1bf2ae2d-1d12-4100-a500-74ef24be97f3 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:57.469324 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1bf2ae2d-1d12-4100-a500-74ef24be97f3 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:57.470134 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1bf2ae2d-1d12-4100-a500-74ef24be97f3 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:57.470573 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1bf2ae2d-1d12-4100-a500-74ef24be97f3 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:57.607310 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1bf2ae2d-1d12-4100-a500-74ef24be97f3 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:28:57.615588 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1bf2ae2d-1d12-4100-a500-74ef24be97f3 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa" status: 200 len: 1681 microversion: 2.1 time: 0.165624 May 23 17:28:57.616139 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 488/993] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:28:57 2022] GET /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:28:58.604296 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-85159d47-a7e5-4f87-a7ac-b11a19244228 req-21eed17f-6897-4ba7-af55-a6b92525ddbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "937a33f5-bc7d-4e24-accc-b2f46fed62aa", "name": "network-vif-deleted", "tag": "4316d7e8-7afe-4701-bea9-f697c48dc5c4"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:28:58.613757 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-85159d47-a7e5-4f87-a7ac-b11a19244228 req-21eed17f-6897-4ba7-af55-a6b92525ddbb service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:58.614143 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-85159d47-a7e5-4f87-a7ac-b11a19244228 req-21eed17f-6897-4ba7-af55-a6b92525ddbb service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:58.625824 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-85159d47-a7e5-4f87-a7ac-b11a19244228 req-21eed17f-6897-4ba7-af55-a6b92525ddbb service nova] Creating event network-vif-deleted:4316d7e8-7afe-4701-bea9-f697c48dc5c4 for instance 937a33f5-bc7d-4e24-accc-b2f46fed62aa on hv-cinder-84299 May 23 17:28:58.630896 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-85159d47-a7e5-4f87-a7ac-b11a19244228 req-21eed17f-6897-4ba7-af55-a6b92525ddbb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030457 May 23 17:28:58.634152 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-47869086-603f-4c6a-95e7-857df0f48c6c tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:28:58.634608 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 506/994] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:28:58.635756 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-47869086-603f-4c6a-95e7-857df0f48c6c tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 937a33f5-bc7d-4e24-accc-b2f46fed62aa] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:28:58.643422 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-47869086-603f-4c6a-95e7-857df0f48c6c tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:58.644776 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-47869086-603f-4c6a-95e7-857df0f48c6c tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:58.645751 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-47869086-603f-4c6a-95e7-857df0f48c6c tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:58.646346 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-47869086-603f-4c6a-95e7-857df0f48c6c tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:58.714363 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-47869086-603f-4c6a-95e7-857df0f48c6c tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4780bb497234a249b6d23afdab14370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c5da8fa182486990154b6f22539593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:28:58.723847 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-47869086-603f-4c6a-95e7-857df0f48c6c tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa" status: 200 len: 1325 microversion: 2.1 time: 0.094511 May 23 17:28:58.735390 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 489/995] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:28:58 2022] GET /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa => generated 1325 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 17:28:59.745279 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2ee0c0af-b335-41d9-bc3c-d78a86150dd5 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:28:59.746069 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2ee0c0af-b335-41d9-bc3c-d78a86150dd5 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 937a33f5-bc7d-4e24-accc-b2f46fed62aa] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:28:59.753290 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2ee0c0af-b335-41d9-bc3c-d78a86150dd5 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:59.753738 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2ee0c0af-b335-41d9-bc3c-d78a86150dd5 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:59.754483 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2ee0c0af-b335-41d9-bc3c-d78a86150dd5 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:28:59.754911 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2ee0c0af-b335-41d9-bc3c-d78a86150dd5 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:28:59.768829 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-2ee0c0af-b335-41d9-bc3c-d78a86150dd5 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] HTTP exception thrown: Instance 937a33f5-bc7d-4e24-accc-b2f46fed62aa could not be found. May 23 17:28:59.770440 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2ee0c0af-b335-41d9-bc3c-d78a86150dd5 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Request method failure captured: May 23 17:28:59.770440 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: request: GET /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa HTTP/1.1 May 23 17:28:59.770440 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept: application/json May 23 17:28:59.770440 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity May 23 17:28:59.770440 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Connection: close May 23 17:28:59.770440 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Length: 0 May 23 17:28:59.770440 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Type: application/json May 23 17:28:59.770440 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Host: 10.222.0.46 May 23 17:28:59.770440 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None May 23 17:28:59.770440 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.9 May 23 17:28:59.770440 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABii8NlLxi80dSOGWL-lavmFeqdu7SsvZyfTIUgOEBMGxHagzi4-1UBzzWbKQ8ofm4C3ey4lzhkyKgnXXkVv8I8JI8XYGl9o7m9yKgGHy9m_tm7J0ml_lU8wosqr4A40dh-VL78ZzvIVJ9JNStDlW1mMD3CLnYBqgsXfzf-XjoMWG-RrH8 May 23 17:28:59.770440 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Id: None May 23 17:28:59.770440 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Name: None May 23 17:28:59.770440 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed May 23 17:28:59.770440 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True May 23 17:28:59.770440 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default May 23 17:28:59.770440 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default May 23 17:28:59.770440 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Id: 43c5da8fa182486990154b6f22539593 May 23 17:28:59.770440 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-AttachVolumeNegativeTest-200847774 May 23 17:28:59.770440 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Role: reader,member May 23 17:28:59.770440 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Roles: reader,member May 23 17:28:59.771955 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43c5da8fa182486990154b6f22539593"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/43c5da8fa182486990154b6f22539593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43c5da8fa182486990154b6f22539593"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_43c5da8fa182486990154b6f22539593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:28:59.771955 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-AttachVolumeNegativeTest-200847774 May 23 17:28:59.771955 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 43c5da8fa182486990154b6f22539593 May 23 17:28:59.771955 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-200847774 May 23 17:28:59.771955 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User: tempest-AttachVolumeNegativeTest-200847774-project May 23 17:28:59.771955 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default May 23 17:28:59.771955 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default May 23 17:28:59.771955 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Id: b4780bb497234a249b6d23afdab14370 May 23 17:28:59.771955 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-AttachVolumeNegativeTest-200847774-project May 23 17:28:59.771955 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: method: > May 23 17:28:59.771955 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: exception: Instance 937a33f5-bc7d-4e24-accc-b2f46fed62aa could not be found. May 23 17:28:59.771955 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: action_args: {'id': '937a33f5-bc7d-4e24-accc-b2f46fed62aa'} May 23 17:28:59.772785 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:28:59.772785 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:28:59.772785 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:28:59.772785 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:28:59.772785 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:28:59.772785 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:28:59.772785 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:28:59.772785 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:28:59.772785 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:28:59.772785 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:28:59.772785 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 937a33f5-bc7d-4e24-accc-b2f46fed62aa could not be found. May 23 17:28:59.772785 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:28:59.772785 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:28:59.772785 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:28:59.772785 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:28:59.772785 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:28:59.772785 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:28:59.772785 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:28:59.772785 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:28:59.772785 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:28:59.774203 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:28:59.774203 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 17:28:59.774203 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 17:28:59.774203 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:28:59.774203 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:28:59.774203 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:28:59.774203 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:28:59.774203 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 937a33f5-bc7d-4e24-accc-b2f46fed62aa could not be found. May 23 17:28:59.774203 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:28:59.774203 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:28:59.774203 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:28:59.774203 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:28:59.774203 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:28:59.774203 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:28:59.774203 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:28:59.774203 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:28:59.774203 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 937a33f5-bc7d-4e24-accc-b2f46fed62aa could not be found. May 23 17:28:59.774203 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:28:59.775546 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2ee0c0af-b335-41d9-bc3c-d78a86150dd5 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Returning 404 to user: Instance 937a33f5-bc7d-4e24-accc-b2f46fed62aa could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:28:59.775546 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2ee0c0af-b335-41d9-bc3c-d78a86150dd5 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa" status: 404 len: 111 microversion: 2.1 time: 0.034016 May 23 17:28:59.775546 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 507/996] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:28:59 2022] GET /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:28:59.781089 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-fc63b09c-d07e-4068-89d2-585789a0512e tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '.version_select at 0x7fd793d8ea60>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:28:59.801851 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-fc63b09c-d07e-4068-89d2-585789a0512e tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-592123273" status: 202 len: 0 microversion: 2.1 time: 0.023829 May 23 17:28:59.806105 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 490/997] 10.222.0.46 () {58 vars in 1217 bytes} [Mon May 23 17:28:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-592123273 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 17:29:01.596957 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d2b3f0e4-3e37-40ba-814e-af7ec39e07f6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:29:01.597473 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d2b3f0e4-3e37-40ba-814e-af7ec39e07f6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 937a33f5-bc7d-4e24-accc-b2f46fed62aa] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:29:01.604242 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d2b3f0e4-3e37-40ba-814e-af7ec39e07f6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:29:01.604721 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d2b3f0e4-3e37-40ba-814e-af7ec39e07f6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:29:01.605484 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d2b3f0e4-3e37-40ba-814e-af7ec39e07f6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:29:01.605883 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d2b3f0e4-3e37-40ba-814e-af7ec39e07f6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:29:01.619896 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-d2b3f0e4-3e37-40ba-814e-af7ec39e07f6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] HTTP exception thrown: Instance 937a33f5-bc7d-4e24-accc-b2f46fed62aa could not be found. May 23 17:29:01.621472 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d2b3f0e4-3e37-40ba-814e-af7ec39e07f6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Request method failure captured: May 23 17:29:01.621472 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: request: DELETE /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa HTTP/1.1 May 23 17:29:01.621472 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept: application/json May 23 17:29:01.621472 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity May 23 17:29:01.621472 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Connection: close May 23 17:29:01.621472 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Length: 0 May 23 17:29:01.621472 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Type: application/json May 23 17:29:01.621472 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Host: 10.222.0.46 May 23 17:29:01.621472 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None May 23 17:29:01.621472 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.9 May 23 17:29:01.621472 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABii8NlLxi80dSOGWL-lavmFeqdu7SsvZyfTIUgOEBMGxHagzi4-1UBzzWbKQ8ofm4C3ey4lzhkyKgnXXkVv8I8JI8XYGl9o7m9yKgGHy9m_tm7J0ml_lU8wosqr4A40dh-VL78ZzvIVJ9JNStDlW1mMD3CLnYBqgsXfzf-XjoMWG-RrH8 May 23 17:29:01.621472 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Id: None May 23 17:29:01.621472 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Name: None May 23 17:29:01.621472 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed May 23 17:29:01.621472 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True May 23 17:29:01.621472 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default May 23 17:29:01.621472 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default May 23 17:29:01.621472 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Id: 43c5da8fa182486990154b6f22539593 May 23 17:29:01.621472 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-AttachVolumeNegativeTest-200847774 May 23 17:29:01.621472 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Role: reader,member May 23 17:29:01.621472 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Roles: reader,member May 23 17:29:01.623052 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43c5da8fa182486990154b6f22539593"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/43c5da8fa182486990154b6f22539593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43c5da8fa182486990154b6f22539593"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_43c5da8fa182486990154b6f22539593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:29:01.623052 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-AttachVolumeNegativeTest-200847774 May 23 17:29:01.623052 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 43c5da8fa182486990154b6f22539593 May 23 17:29:01.623052 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-200847774 May 23 17:29:01.623052 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User: tempest-AttachVolumeNegativeTest-200847774-project May 23 17:29:01.623052 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default May 23 17:29:01.623052 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default May 23 17:29:01.623052 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Id: b4780bb497234a249b6d23afdab14370 May 23 17:29:01.623052 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-AttachVolumeNegativeTest-200847774-project May 23 17:29:01.623052 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: method: > May 23 17:29:01.623052 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: exception: Instance 937a33f5-bc7d-4e24-accc-b2f46fed62aa could not be found. May 23 17:29:01.623052 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: action_args: {'id': '937a33f5-bc7d-4e24-accc-b2f46fed62aa'} May 23 17:29:01.623962 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:29:01.623962 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:29:01.623962 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:29:01.623962 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:29:01.623962 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:29:01.623962 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:29:01.623962 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:29:01.623962 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:29:01.623962 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:29:01.623962 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:29:01.623962 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 937a33f5-bc7d-4e24-accc-b2f46fed62aa could not be found. May 23 17:29:01.623962 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:29:01.623962 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:29:01.623962 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:29:01.623962 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:29:01.623962 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:29:01.623962 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:29:01.623962 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:29:01.623962 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:29:01.623962 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:29:01.625501 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:29:01.625501 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 17:29:01.625501 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 17:29:01.625501 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 17:29:01.625501 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 17:29:01.625501 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:29:01.625501 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:29:01.625501 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:29:01.625501 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:29:01.625501 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 937a33f5-bc7d-4e24-accc-b2f46fed62aa could not be found. May 23 17:29:01.625501 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:29:01.625501 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:29:01.625501 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:29:01.625501 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:29:01.625501 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:29:01.625501 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:29:01.625501 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:29:01.625501 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:29:01.625501 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 937a33f5-bc7d-4e24-accc-b2f46fed62aa could not be found. May 23 17:29:01.625501 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:29:01.627278 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d2b3f0e4-3e37-40ba-814e-af7ec39e07f6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Returning 404 to user: Instance 937a33f5-bc7d-4e24-accc-b2f46fed62aa could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:29:01.627278 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d2b3f0e4-3e37-40ba-814e-af7ec39e07f6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "DELETE /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa" status: 404 len: 111 microversion: 2.1 time: 0.029869 May 23 17:29:01.627278 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 508/998] 10.222.0.46 () {58 vars in 1238 bytes} [Mon May 23 17:29:01 2022] DELETE /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:29:01.635050 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4c914b11-419f-452b-8f0d-fcf0a344bc60 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:29:01.636004 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4c914b11-419f-452b-8f0d-fcf0a344bc60 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 937a33f5-bc7d-4e24-accc-b2f46fed62aa] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:29:01.645443 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c914b11-419f-452b-8f0d-fcf0a344bc60 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:29:01.645902 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c914b11-419f-452b-8f0d-fcf0a344bc60 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:29:01.646683 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c914b11-419f-452b-8f0d-fcf0a344bc60 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:29:01.647133 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c914b11-419f-452b-8f0d-fcf0a344bc60 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:29:01.660568 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-4c914b11-419f-452b-8f0d-fcf0a344bc60 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] HTTP exception thrown: Instance 937a33f5-bc7d-4e24-accc-b2f46fed62aa could not be found. May 23 17:29:01.662259 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4c914b11-419f-452b-8f0d-fcf0a344bc60 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Request method failure captured: May 23 17:29:01.662259 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: request: GET /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa HTTP/1.1 May 23 17:29:01.662259 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept: application/json May 23 17:29:01.662259 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity May 23 17:29:01.662259 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Connection: close May 23 17:29:01.662259 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Length: 0 May 23 17:29:01.662259 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Type: application/json May 23 17:29:01.662259 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Host: 10.222.0.46 May 23 17:29:01.662259 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None May 23 17:29:01.662259 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.9 May 23 17:29:01.662259 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABii8NlLxi80dSOGWL-lavmFeqdu7SsvZyfTIUgOEBMGxHagzi4-1UBzzWbKQ8ofm4C3ey4lzhkyKgnXXkVv8I8JI8XYGl9o7m9yKgGHy9m_tm7J0ml_lU8wosqr4A40dh-VL78ZzvIVJ9JNStDlW1mMD3CLnYBqgsXfzf-XjoMWG-RrH8 May 23 17:29:01.662259 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Id: None May 23 17:29:01.662259 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Name: None May 23 17:29:01.662259 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed May 23 17:29:01.662259 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True May 23 17:29:01.662259 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default May 23 17:29:01.662259 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default May 23 17:29:01.662259 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Id: 43c5da8fa182486990154b6f22539593 May 23 17:29:01.662259 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-AttachVolumeNegativeTest-200847774 May 23 17:29:01.662259 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Role: reader,member May 23 17:29:01.662259 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Roles: reader,member May 23 17:29:01.663773 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43c5da8fa182486990154b6f22539593"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/43c5da8fa182486990154b6f22539593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43c5da8fa182486990154b6f22539593"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_43c5da8fa182486990154b6f22539593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:29:01.663773 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-AttachVolumeNegativeTest-200847774 May 23 17:29:01.663773 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 43c5da8fa182486990154b6f22539593 May 23 17:29:01.663773 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-200847774 May 23 17:29:01.663773 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User: tempest-AttachVolumeNegativeTest-200847774-project May 23 17:29:01.663773 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default May 23 17:29:01.663773 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default May 23 17:29:01.663773 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Id: b4780bb497234a249b6d23afdab14370 May 23 17:29:01.663773 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-AttachVolumeNegativeTest-200847774-project May 23 17:29:01.663773 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: method: > May 23 17:29:01.663773 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: exception: Instance 937a33f5-bc7d-4e24-accc-b2f46fed62aa could not be found. May 23 17:29:01.663773 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: action_args: {'id': '937a33f5-bc7d-4e24-accc-b2f46fed62aa'} May 23 17:29:01.664739 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:29:01.664739 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:29:01.664739 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:29:01.664739 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:29:01.664739 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:29:01.664739 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:29:01.664739 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:29:01.664739 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:29:01.664739 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:29:01.664739 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:29:01.664739 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 937a33f5-bc7d-4e24-accc-b2f46fed62aa could not be found. May 23 17:29:01.664739 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:29:01.664739 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:29:01.664739 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:29:01.664739 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:29:01.664739 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:29:01.664739 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:29:01.664739 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:29:01.664739 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:29:01.664739 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:29:01.666272 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:29:01.666272 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 17:29:01.666272 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 17:29:01.666272 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:29:01.666272 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:29:01.666272 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:29:01.666272 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:29:01.666272 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 937a33f5-bc7d-4e24-accc-b2f46fed62aa could not be found. May 23 17:29:01.666272 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:29:01.666272 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:29:01.666272 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:29:01.666272 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:29:01.666272 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:29:01.666272 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:29:01.666272 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:29:01.666272 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:29:01.666272 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 937a33f5-bc7d-4e24-accc-b2f46fed62aa could not be found. May 23 17:29:01.666272 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:29:01.667757 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4c914b11-419f-452b-8f0d-fcf0a344bc60 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Returning 404 to user: Instance 937a33f5-bc7d-4e24-accc-b2f46fed62aa could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:29:01.667757 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4c914b11-419f-452b-8f0d-fcf0a344bc60 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa" status: 404 len: 111 microversion: 2.1 time: 0.035153 May 23 17:29:01.667757 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 491/999] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:29:01 2022] GET /compute/v2.1/servers/937a33f5-bc7d-4e24-accc-b2f46fed62aa => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:29:02.815891 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a9d58d20-4736-4ebc-8a10-debd2d78d9f6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:29:02.816518 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-a9d58d20-4736-4ebc-8a10-debd2d78d9f6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: ca5370ce-8356-449c-be5b-fb4c0afb4080] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:29:02.823299 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a9d58d20-4736-4ebc-8a10-debd2d78d9f6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:29:02.823809 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a9d58d20-4736-4ebc-8a10-debd2d78d9f6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:29:02.824573 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a9d58d20-4736-4ebc-8a10-debd2d78d9f6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:29:02.825026 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a9d58d20-4736-4ebc-8a10-debd2d78d9f6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:29:02.840131 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-a9d58d20-4736-4ebc-8a10-debd2d78d9f6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] HTTP exception thrown: Instance ca5370ce-8356-449c-be5b-fb4c0afb4080 could not be found. May 23 17:29:02.841684 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a9d58d20-4736-4ebc-8a10-debd2d78d9f6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Request method failure captured: May 23 17:29:02.841684 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: request: DELETE /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080 HTTP/1.1 May 23 17:29:02.841684 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept: application/json May 23 17:29:02.841684 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity May 23 17:29:02.841684 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Connection: close May 23 17:29:02.841684 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Length: 0 May 23 17:29:02.841684 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Type: application/json May 23 17:29:02.841684 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Host: 10.222.0.46 May 23 17:29:02.841684 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None May 23 17:29:02.841684 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.9 May 23 17:29:02.841684 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABii8NlLxi80dSOGWL-lavmFeqdu7SsvZyfTIUgOEBMGxHagzi4-1UBzzWbKQ8ofm4C3ey4lzhkyKgnXXkVv8I8JI8XYGl9o7m9yKgGHy9m_tm7J0ml_lU8wosqr4A40dh-VL78ZzvIVJ9JNStDlW1mMD3CLnYBqgsXfzf-XjoMWG-RrH8 May 23 17:29:02.841684 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Id: None May 23 17:29:02.841684 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Name: None May 23 17:29:02.841684 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed May 23 17:29:02.841684 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True May 23 17:29:02.841684 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default May 23 17:29:02.841684 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default May 23 17:29:02.841684 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Id: 43c5da8fa182486990154b6f22539593 May 23 17:29:02.841684 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-AttachVolumeNegativeTest-200847774 May 23 17:29:02.841684 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Role: reader,member May 23 17:29:02.841684 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Roles: reader,member May 23 17:29:02.843477 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43c5da8fa182486990154b6f22539593"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/43c5da8fa182486990154b6f22539593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43c5da8fa182486990154b6f22539593"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_43c5da8fa182486990154b6f22539593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:29:02.843477 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-AttachVolumeNegativeTest-200847774 May 23 17:29:02.843477 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 43c5da8fa182486990154b6f22539593 May 23 17:29:02.843477 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-200847774 May 23 17:29:02.843477 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User: tempest-AttachVolumeNegativeTest-200847774-project May 23 17:29:02.843477 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default May 23 17:29:02.843477 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default May 23 17:29:02.843477 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Id: b4780bb497234a249b6d23afdab14370 May 23 17:29:02.843477 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-AttachVolumeNegativeTest-200847774-project May 23 17:29:02.843477 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: method: > May 23 17:29:02.843477 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: exception: Instance ca5370ce-8356-449c-be5b-fb4c0afb4080 could not be found. May 23 17:29:02.843477 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: action_args: {'id': 'ca5370ce-8356-449c-be5b-fb4c0afb4080'} May 23 17:29:02.844831 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:29:02.844831 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:29:02.844831 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:29:02.844831 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:29:02.844831 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:29:02.844831 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:29:02.844831 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:29:02.844831 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:29:02.844831 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:29:02.844831 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:29:02.844831 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca5370ce-8356-449c-be5b-fb4c0afb4080 could not be found. May 23 17:29:02.844831 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:29:02.844831 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:29:02.844831 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:29:02.844831 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:29:02.844831 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:29:02.844831 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:29:02.844831 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:29:02.844831 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:29:02.844831 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:29:02.847120 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:29:02.847120 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 17:29:02.847120 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 17:29:02.847120 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 17:29:02.847120 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 17:29:02.847120 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:29:02.847120 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:29:02.847120 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:29:02.847120 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:29:02.847120 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca5370ce-8356-449c-be5b-fb4c0afb4080 could not be found. May 23 17:29:02.847120 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:29:02.847120 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:29:02.847120 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:29:02.847120 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:29:02.847120 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:29:02.847120 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:29:02.847120 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:29:02.847120 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:29:02.847120 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca5370ce-8356-449c-be5b-fb4c0afb4080 could not be found. May 23 17:29:02.847120 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:29:02.849055 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a9d58d20-4736-4ebc-8a10-debd2d78d9f6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Returning 404 to user: Instance ca5370ce-8356-449c-be5b-fb4c0afb4080 could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:29:02.849055 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-a9d58d20-4736-4ebc-8a10-debd2d78d9f6 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080" status: 404 len: 111 microversion: 2.1 time: 0.031778 May 23 17:29:02.849055 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 509/1000] 10.222.0.46 () {58 vars in 1238 bytes} [Mon May 23 17:29:02 2022] DELETE /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:29:02.853659 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-af4018a9-d7f4-484c-a05a-3dd9789f3772 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:29:02.854265 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-af4018a9-d7f4-484c-a05a-3dd9789f3772 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: ca5370ce-8356-449c-be5b-fb4c0afb4080] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:29:02.861186 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-af4018a9-d7f4-484c-a05a-3dd9789f3772 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:29:02.861634 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-af4018a9-d7f4-484c-a05a-3dd9789f3772 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:29:02.862416 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-af4018a9-d7f4-484c-a05a-3dd9789f3772 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:29:02.862869 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-af4018a9-d7f4-484c-a05a-3dd9789f3772 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:29:02.876946 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-af4018a9-d7f4-484c-a05a-3dd9789f3772 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] HTTP exception thrown: Instance ca5370ce-8356-449c-be5b-fb4c0afb4080 could not be found. May 23 17:29:02.878477 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-af4018a9-d7f4-484c-a05a-3dd9789f3772 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Request method failure captured: May 23 17:29:02.878477 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: request: GET /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080 HTTP/1.1 May 23 17:29:02.878477 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept: application/json May 23 17:29:02.878477 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity May 23 17:29:02.878477 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Connection: close May 23 17:29:02.878477 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Length: 0 May 23 17:29:02.878477 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Type: application/json May 23 17:29:02.878477 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Host: 10.222.0.46 May 23 17:29:02.878477 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None May 23 17:29:02.878477 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.9 May 23 17:29:02.878477 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABii8NlLxi80dSOGWL-lavmFeqdu7SsvZyfTIUgOEBMGxHagzi4-1UBzzWbKQ8ofm4C3ey4lzhkyKgnXXkVv8I8JI8XYGl9o7m9yKgGHy9m_tm7J0ml_lU8wosqr4A40dh-VL78ZzvIVJ9JNStDlW1mMD3CLnYBqgsXfzf-XjoMWG-RrH8 May 23 17:29:02.878477 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Id: None May 23 17:29:02.878477 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Name: None May 23 17:29:02.878477 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed May 23 17:29:02.878477 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True May 23 17:29:02.878477 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default May 23 17:29:02.878477 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default May 23 17:29:02.878477 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Id: 43c5da8fa182486990154b6f22539593 May 23 17:29:02.878477 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-AttachVolumeNegativeTest-200847774 May 23 17:29:02.878477 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Role: reader,member May 23 17:29:02.878477 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Roles: reader,member May 23 17:29:02.880131 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43c5da8fa182486990154b6f22539593"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/43c5da8fa182486990154b6f22539593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43c5da8fa182486990154b6f22539593"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_43c5da8fa182486990154b6f22539593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:29:02.880131 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-AttachVolumeNegativeTest-200847774 May 23 17:29:02.880131 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 43c5da8fa182486990154b6f22539593 May 23 17:29:02.880131 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-200847774 May 23 17:29:02.880131 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User: tempest-AttachVolumeNegativeTest-200847774-project May 23 17:29:02.880131 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default May 23 17:29:02.880131 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default May 23 17:29:02.880131 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Id: b4780bb497234a249b6d23afdab14370 May 23 17:29:02.880131 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-AttachVolumeNegativeTest-200847774-project May 23 17:29:02.880131 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: method: > May 23 17:29:02.880131 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: exception: Instance ca5370ce-8356-449c-be5b-fb4c0afb4080 could not be found. May 23 17:29:02.880131 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: action_args: {'id': 'ca5370ce-8356-449c-be5b-fb4c0afb4080'} May 23 17:29:02.880986 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:29:02.880986 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:29:02.880986 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:29:02.880986 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:29:02.880986 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:29:02.880986 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:29:02.880986 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:29:02.880986 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:29:02.880986 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:29:02.880986 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:29:02.880986 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca5370ce-8356-449c-be5b-fb4c0afb4080 could not be found. May 23 17:29:02.880986 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:29:02.880986 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:29:02.880986 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:29:02.880986 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:29:02.880986 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:29:02.880986 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:29:02.880986 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:29:02.880986 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:29:02.880986 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:29:02.882240 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:29:02.882240 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 17:29:02.882240 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 17:29:02.882240 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:29:02.882240 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:29:02.882240 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:29:02.882240 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:29:02.882240 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca5370ce-8356-449c-be5b-fb4c0afb4080 could not be found. May 23 17:29:02.882240 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:29:02.882240 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:29:02.882240 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:29:02.882240 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:29:02.882240 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:29:02.882240 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:29:02.882240 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:29:02.882240 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:29:02.882240 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca5370ce-8356-449c-be5b-fb4c0afb4080 could not be found. May 23 17:29:02.882240 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:29:02.883338 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-af4018a9-d7f4-484c-a05a-3dd9789f3772 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Returning 404 to user: Instance ca5370ce-8356-449c-be5b-fb4c0afb4080 could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:29:02.883338 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-af4018a9-d7f4-484c-a05a-3dd9789f3772 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080" status: 404 len: 111 microversion: 2.1 time: 0.030060 May 23 17:29:02.883338 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 492/1001] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:29:02 2022] GET /compute/v2.1/servers/ca5370ce-8356-449c-be5b-fb4c0afb4080 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:29:02.891094 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-ed6abd75-daa7-45df-840a-91a4cd613813 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:29:02.891602 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-ed6abd75-daa7-45df-840a-91a4cd613813 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 95a14987-7a38-406c-b32b-08c1a601f883] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:29:02.898193 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ed6abd75-daa7-45df-840a-91a4cd613813 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:29:02.898653 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ed6abd75-daa7-45df-840a-91a4cd613813 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:29:02.899431 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ed6abd75-daa7-45df-840a-91a4cd613813 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:29:02.899873 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ed6abd75-daa7-45df-840a-91a4cd613813 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:29:02.913913 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-ed6abd75-daa7-45df-840a-91a4cd613813 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] HTTP exception thrown: Instance 95a14987-7a38-406c-b32b-08c1a601f883 could not be found. May 23 17:29:02.915489 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-ed6abd75-daa7-45df-840a-91a4cd613813 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Request method failure captured: May 23 17:29:02.915489 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: request: DELETE /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883 HTTP/1.1 May 23 17:29:02.915489 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept: application/json May 23 17:29:02.915489 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity May 23 17:29:02.915489 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Connection: close May 23 17:29:02.915489 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Length: 0 May 23 17:29:02.915489 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Type: application/json May 23 17:29:02.915489 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Host: 10.222.0.46 May 23 17:29:02.915489 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None May 23 17:29:02.915489 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.9 May 23 17:29:02.915489 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABii8NlLxi80dSOGWL-lavmFeqdu7SsvZyfTIUgOEBMGxHagzi4-1UBzzWbKQ8ofm4C3ey4lzhkyKgnXXkVv8I8JI8XYGl9o7m9yKgGHy9m_tm7J0ml_lU8wosqr4A40dh-VL78ZzvIVJ9JNStDlW1mMD3CLnYBqgsXfzf-XjoMWG-RrH8 May 23 17:29:02.915489 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Id: None May 23 17:29:02.915489 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Name: None May 23 17:29:02.915489 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed May 23 17:29:02.915489 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True May 23 17:29:02.915489 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default May 23 17:29:02.915489 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default May 23 17:29:02.915489 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Id: 43c5da8fa182486990154b6f22539593 May 23 17:29:02.915489 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-AttachVolumeNegativeTest-200847774 May 23 17:29:02.915489 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Role: reader,member May 23 17:29:02.915489 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Roles: reader,member May 23 17:29:02.917077 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43c5da8fa182486990154b6f22539593"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/43c5da8fa182486990154b6f22539593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43c5da8fa182486990154b6f22539593"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_43c5da8fa182486990154b6f22539593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:29:02.917077 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-AttachVolumeNegativeTest-200847774 May 23 17:29:02.917077 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 43c5da8fa182486990154b6f22539593 May 23 17:29:02.917077 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-200847774 May 23 17:29:02.917077 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User: tempest-AttachVolumeNegativeTest-200847774-project May 23 17:29:02.917077 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default May 23 17:29:02.917077 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default May 23 17:29:02.917077 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Id: b4780bb497234a249b6d23afdab14370 May 23 17:29:02.917077 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-AttachVolumeNegativeTest-200847774-project May 23 17:29:02.917077 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: method: > May 23 17:29:02.917077 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: exception: Instance 95a14987-7a38-406c-b32b-08c1a601f883 could not be found. May 23 17:29:02.917077 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: action_args: {'id': '95a14987-7a38-406c-b32b-08c1a601f883'} May 23 17:29:02.918148 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:29:02.918148 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:29:02.918148 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:29:02.918148 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:29:02.918148 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:29:02.918148 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:29:02.918148 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:29:02.918148 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:29:02.918148 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:29:02.918148 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:29:02.918148 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95a14987-7a38-406c-b32b-08c1a601f883 could not be found. May 23 17:29:02.918148 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:29:02.918148 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:29:02.918148 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:29:02.918148 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:29:02.918148 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:29:02.918148 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:29:02.918148 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:29:02.918148 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:29:02.918148 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:29:02.919676 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:29:02.919676 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 17:29:02.919676 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 17:29:02.919676 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 17:29:02.919676 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 17:29:02.919676 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:29:02.919676 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:29:02.919676 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:29:02.919676 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:29:02.919676 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95a14987-7a38-406c-b32b-08c1a601f883 could not be found. May 23 17:29:02.919676 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:29:02.919676 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:29:02.919676 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:29:02.919676 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:29:02.919676 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:29:02.919676 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:29:02.919676 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:29:02.919676 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:29:02.919676 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95a14987-7a38-406c-b32b-08c1a601f883 could not be found. May 23 17:29:02.919676 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:29:02.921640 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-ed6abd75-daa7-45df-840a-91a4cd613813 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Returning 404 to user: Instance 95a14987-7a38-406c-b32b-08c1a601f883 could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:29:02.921640 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-ed6abd75-daa7-45df-840a-91a4cd613813 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "DELETE /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883" status: 404 len: 111 microversion: 2.1 time: 0.032229 May 23 17:29:02.921640 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 510/1002] 10.222.0.46 () {58 vars in 1238 bytes} [Mon May 23 17:29:02 2022] DELETE /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:29:02.925387 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-07ce2873-eff9-4f2c-824d-340b68ae16b4 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:29:02.925993 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-07ce2873-eff9-4f2c-824d-340b68ae16b4 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 95a14987-7a38-406c-b32b-08c1a601f883] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:29:02.933796 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-07ce2873-eff9-4f2c-824d-340b68ae16b4 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:29:02.934592 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-07ce2873-eff9-4f2c-824d-340b68ae16b4 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:29:02.935799 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-07ce2873-eff9-4f2c-824d-340b68ae16b4 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:29:02.936274 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-07ce2873-eff9-4f2c-824d-340b68ae16b4 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:29:02.949921 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-07ce2873-eff9-4f2c-824d-340b68ae16b4 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] HTTP exception thrown: Instance 95a14987-7a38-406c-b32b-08c1a601f883 could not be found. May 23 17:29:02.951458 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-07ce2873-eff9-4f2c-824d-340b68ae16b4 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Request method failure captured: May 23 17:29:02.951458 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: request: GET /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883 HTTP/1.1 May 23 17:29:02.951458 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept: application/json May 23 17:29:02.951458 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity May 23 17:29:02.951458 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Connection: close May 23 17:29:02.951458 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Length: 0 May 23 17:29:02.951458 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Type: application/json May 23 17:29:02.951458 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Host: 10.222.0.46 May 23 17:29:02.951458 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None May 23 17:29:02.951458 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.9 May 23 17:29:02.951458 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABii8NlLxi80dSOGWL-lavmFeqdu7SsvZyfTIUgOEBMGxHagzi4-1UBzzWbKQ8ofm4C3ey4lzhkyKgnXXkVv8I8JI8XYGl9o7m9yKgGHy9m_tm7J0ml_lU8wosqr4A40dh-VL78ZzvIVJ9JNStDlW1mMD3CLnYBqgsXfzf-XjoMWG-RrH8 May 23 17:29:02.951458 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Id: None May 23 17:29:02.951458 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Name: None May 23 17:29:02.951458 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed May 23 17:29:02.951458 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True May 23 17:29:02.951458 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default May 23 17:29:02.951458 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default May 23 17:29:02.951458 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Id: 43c5da8fa182486990154b6f22539593 May 23 17:29:02.951458 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-AttachVolumeNegativeTest-200847774 May 23 17:29:02.951458 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Role: reader,member May 23 17:29:02.951458 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Roles: reader,member May 23 17:29:02.953329 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43c5da8fa182486990154b6f22539593"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/43c5da8fa182486990154b6f22539593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43c5da8fa182486990154b6f22539593"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_43c5da8fa182486990154b6f22539593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:29:02.953329 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-AttachVolumeNegativeTest-200847774 May 23 17:29:02.953329 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 43c5da8fa182486990154b6f22539593 May 23 17:29:02.953329 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-200847774 May 23 17:29:02.953329 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User: tempest-AttachVolumeNegativeTest-200847774-project May 23 17:29:02.953329 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default May 23 17:29:02.953329 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default May 23 17:29:02.953329 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Id: b4780bb497234a249b6d23afdab14370 May 23 17:29:02.953329 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-AttachVolumeNegativeTest-200847774-project May 23 17:29:02.953329 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: method: > May 23 17:29:02.953329 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: exception: Instance 95a14987-7a38-406c-b32b-08c1a601f883 could not be found. May 23 17:29:02.953329 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: action_args: {'id': '95a14987-7a38-406c-b32b-08c1a601f883'} May 23 17:29:02.954318 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:29:02.954318 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:29:02.954318 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:29:02.954318 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:29:02.954318 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:29:02.954318 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:29:02.954318 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:29:02.954318 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:29:02.954318 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:29:02.954318 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:29:02.954318 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95a14987-7a38-406c-b32b-08c1a601f883 could not be found. May 23 17:29:02.954318 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:29:02.954318 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:29:02.954318 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:29:02.954318 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:29:02.954318 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:29:02.954318 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:29:02.954318 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:29:02.954318 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:29:02.954318 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:29:02.955831 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:29:02.955831 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 17:29:02.955831 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 17:29:02.955831 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:29:02.955831 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:29:02.955831 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:29:02.955831 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:29:02.955831 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95a14987-7a38-406c-b32b-08c1a601f883 could not be found. May 23 17:29:02.955831 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:29:02.955831 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:29:02.955831 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:29:02.955831 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:29:02.955831 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:29:02.955831 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:29:02.955831 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:29:02.955831 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:29:02.955831 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95a14987-7a38-406c-b32b-08c1a601f883 could not be found. May 23 17:29:02.955831 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:29:02.957809 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-07ce2873-eff9-4f2c-824d-340b68ae16b4 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Returning 404 to user: Instance 95a14987-7a38-406c-b32b-08c1a601f883 could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:29:02.957809 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-07ce2873-eff9-4f2c-824d-340b68ae16b4 tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883" status: 404 len: 111 microversion: 2.1 time: 0.031425 May 23 17:29:02.957809 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 493/1003] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:29:02 2022] GET /compute/v2.1/servers/95a14987-7a38-406c-b32b-08c1a601f883 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 17:29:04.112123 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-f5770470-5d02-4016-bc4f-88a98bb26d8c tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:29:04.112743 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-f5770470-5d02-4016-bc4f-88a98bb26d8c tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 161b8434-8d45-4f38-b174-c2c2de66ec87] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:29:04.119742 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f5770470-5d02-4016-bc4f-88a98bb26d8c tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:29:04.120195 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f5770470-5d02-4016-bc4f-88a98bb26d8c tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:29:04.121008 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f5770470-5d02-4016-bc4f-88a98bb26d8c tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:29:04.121455 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f5770470-5d02-4016-bc4f-88a98bb26d8c tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:29:04.135341 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-f5770470-5d02-4016-bc4f-88a98bb26d8c tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] HTTP exception thrown: Instance 161b8434-8d45-4f38-b174-c2c2de66ec87 could not be found. May 23 17:29:04.137305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-f5770470-5d02-4016-bc4f-88a98bb26d8c tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Request method failure captured: May 23 17:29:04.137305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: request: DELETE /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87 HTTP/1.1 May 23 17:29:04.137305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept: application/json May 23 17:29:04.137305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity May 23 17:29:04.137305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Connection: close May 23 17:29:04.137305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Length: 0 May 23 17:29:04.137305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Content-Type: application/json May 23 17:29:04.137305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Host: 10.222.0.46 May 23 17:29:04.137305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None May 23 17:29:04.137305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.9 May 23 17:29:04.137305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABii8NlLxi80dSOGWL-lavmFeqdu7SsvZyfTIUgOEBMGxHagzi4-1UBzzWbKQ8ofm4C3ey4lzhkyKgnXXkVv8I8JI8XYGl9o7m9yKgGHy9m_tm7J0ml_lU8wosqr4A40dh-VL78ZzvIVJ9JNStDlW1mMD3CLnYBqgsXfzf-XjoMWG-RrH8 May 23 17:29:04.137305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Id: None May 23 17:29:04.137305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Domain-Name: None May 23 17:29:04.137305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed May 23 17:29:04.137305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True May 23 17:29:04.137305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default May 23 17:29:04.137305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default May 23 17:29:04.137305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Id: 43c5da8fa182486990154b6f22539593 May 23 17:29:04.137305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-AttachVolumeNegativeTest-200847774 May 23 17:29:04.137305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Role: reader,member May 23 17:29:04.137305 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Roles: reader,member May 23 17:29:04.138857 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43c5da8fa182486990154b6f22539593"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/43c5da8fa182486990154b6f22539593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43c5da8fa182486990154b6f22539593"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_43c5da8fa182486990154b6f22539593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:29:04.138857 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-AttachVolumeNegativeTest-200847774 May 23 17:29:04.138857 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 43c5da8fa182486990154b6f22539593 May 23 17:29:04.138857 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-200847774 May 23 17:29:04.138857 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User: tempest-AttachVolumeNegativeTest-200847774-project May 23 17:29:04.138857 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default May 23 17:29:04.138857 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default May 23 17:29:04.138857 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Id: b4780bb497234a249b6d23afdab14370 May 23 17:29:04.138857 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-AttachVolumeNegativeTest-200847774-project May 23 17:29:04.138857 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: method: > May 23 17:29:04.138857 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: exception: Instance 161b8434-8d45-4f38-b174-c2c2de66ec87 could not be found. May 23 17:29:04.138857 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: action_args: {'id': '161b8434-8d45-4f38-b174-c2c2de66ec87'} May 23 17:29:04.139746 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:29:04.139746 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:29:04.139746 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:29:04.139746 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:29:04.139746 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:29:04.139746 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:29:04.139746 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:29:04.139746 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:29:04.139746 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:29:04.139746 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:29:04.139746 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 161b8434-8d45-4f38-b174-c2c2de66ec87 could not be found. May 23 17:29:04.139746 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:29:04.139746 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:29:04.139746 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:29:04.139746 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:29:04.139746 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:29:04.139746 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:29:04.139746 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:29:04.139746 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:29:04.139746 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:29:04.141300 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:29:04.141300 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 17:29:04.141300 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 17:29:04.141300 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 17:29:04.141300 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 17:29:04.141300 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:29:04.141300 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:29:04.141300 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:29:04.141300 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:29:04.141300 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 161b8434-8d45-4f38-b174-c2c2de66ec87 could not be found. May 23 17:29:04.141300 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:29:04.141300 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:29:04.141300 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:29:04.141300 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:29:04.141300 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:29:04.141300 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:29:04.141300 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:29:04.141300 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:29:04.141300 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 161b8434-8d45-4f38-b174-c2c2de66ec87 could not be found. May 23 17:29:04.141300 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi May 23 17:29:04.142836 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-f5770470-5d02-4016-bc4f-88a98bb26d8c tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Returning 404 to user: Instance 161b8434-8d45-4f38-b174-c2c2de66ec87 could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:29:04.142836 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-f5770470-5d02-4016-bc4f-88a98bb26d8c tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "DELETE /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87" status: 404 len: 111 microversion: 2.1 time: 0.030552 May 23 17:29:04.142836 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 511/1004] 10.222.0.46 () {58 vars in 1238 bytes} [Mon May 23 17:29:04 2022] DELETE /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:29:04.147525 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-cd4a568a-eda4-4991-a591-f33f56df58ee tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:29:04.148147 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-cd4a568a-eda4-4991-a591-f33f56df58ee tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] [instance: 161b8434-8d45-4f38-b174-c2c2de66ec87] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:29:04.155079 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cd4a568a-eda4-4991-a591-f33f56df58ee tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:29:04.155534 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cd4a568a-eda4-4991-a591-f33f56df58ee tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:29:04.156316 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cd4a568a-eda4-4991-a591-f33f56df58ee tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:29:04.156801 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cd4a568a-eda4-4991-a591-f33f56df58ee tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:29:04.170487 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-cd4a568a-eda4-4991-a591-f33f56df58ee tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] HTTP exception thrown: Instance 161b8434-8d45-4f38-b174-c2c2de66ec87 could not be found. May 23 17:29:04.172009 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-cd4a568a-eda4-4991-a591-f33f56df58ee tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Request method failure captured: May 23 17:29:04.172009 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: request: GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87 HTTP/1.1 May 23 17:29:04.172009 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept: application/json May 23 17:29:04.172009 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity May 23 17:29:04.172009 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Connection: close May 23 17:29:04.172009 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Length: 0 May 23 17:29:04.172009 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Type: application/json May 23 17:29:04.172009 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Host: 10.222.0.46 May 23 17:29:04.172009 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None May 23 17:29:04.172009 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.9 May 23 17:29:04.172009 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABii8NlLxi80dSOGWL-lavmFeqdu7SsvZyfTIUgOEBMGxHagzi4-1UBzzWbKQ8ofm4C3ey4lzhkyKgnXXkVv8I8JI8XYGl9o7m9yKgGHy9m_tm7J0ml_lU8wosqr4A40dh-VL78ZzvIVJ9JNStDlW1mMD3CLnYBqgsXfzf-XjoMWG-RrH8 May 23 17:29:04.172009 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Id: None May 23 17:29:04.172009 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Name: None May 23 17:29:04.172009 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed May 23 17:29:04.172009 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True May 23 17:29:04.172009 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default May 23 17:29:04.172009 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default May 23 17:29:04.172009 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Id: 43c5da8fa182486990154b6f22539593 May 23 17:29:04.172009 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-AttachVolumeNegativeTest-200847774 May 23 17:29:04.172009 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Role: reader,member May 23 17:29:04.172009 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Roles: reader,member May 23 17:29:04.173637 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43c5da8fa182486990154b6f22539593"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/43c5da8fa182486990154b6f22539593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43c5da8fa182486990154b6f22539593"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_43c5da8fa182486990154b6f22539593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:29:04.173637 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-AttachVolumeNegativeTest-200847774 May 23 17:29:04.173637 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 43c5da8fa182486990154b6f22539593 May 23 17:29:04.173637 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-200847774 May 23 17:29:04.173637 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User: tempest-AttachVolumeNegativeTest-200847774-project May 23 17:29:04.173637 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default May 23 17:29:04.173637 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default May 23 17:29:04.173637 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Id: b4780bb497234a249b6d23afdab14370 May 23 17:29:04.173637 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-AttachVolumeNegativeTest-200847774-project May 23 17:29:04.173637 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: method: > May 23 17:29:04.173637 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: exception: Instance 161b8434-8d45-4f38-b174-c2c2de66ec87 could not be found. May 23 17:29:04.173637 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: action_args: {'id': '161b8434-8d45-4f38-b174-c2c2de66ec87'} May 23 17:29:04.174553 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:29:04.174553 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:29:04.174553 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:29:04.174553 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:29:04.174553 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:29:04.174553 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:29:04.174553 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:29:04.174553 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:29:04.174553 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:29:04.174553 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:29:04.174553 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 161b8434-8d45-4f38-b174-c2c2de66ec87 could not be found. May 23 17:29:04.174553 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:29:04.174553 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:29:04.174553 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:29:04.174553 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:29:04.174553 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:29:04.174553 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:29:04.174553 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:29:04.174553 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:29:04.174553 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:29:04.176041 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:29:04.176041 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 17:29:04.176041 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 17:29:04.176041 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:29:04.176041 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:29:04.176041 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:29:04.176041 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:29:04.176041 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 161b8434-8d45-4f38-b174-c2c2de66ec87 could not be found. May 23 17:29:04.176041 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:29:04.176041 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:29:04.176041 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:29:04.176041 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:29:04.176041 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:29:04.176041 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:29:04.176041 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:29:04.176041 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:29:04.176041 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 161b8434-8d45-4f38-b174-c2c2de66ec87 could not be found. May 23 17:29:04.176041 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:29:04.177402 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-cd4a568a-eda4-4991-a591-f33f56df58ee tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] Returning 404 to user: Instance 161b8434-8d45-4f38-b174-c2c2de66ec87 could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:29:04.177402 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-cd4a568a-eda4-4991-a591-f33f56df58ee tempest-AttachVolumeNegativeTest-200847774 tempest-AttachVolumeNegativeTest-200847774-project] 10.222.0.46 "GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87" status: 404 len: 111 microversion: 2.1 time: 0.029981 May 23 17:29:04.177402 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 494/1005] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:29:04 2022] GET /compute/v2.1/servers/161b8434-8d45-4f38-b174-c2c2de66ec87 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 17:30:28.097436 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=20 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:30:28.098555 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=37,nova_cell1:INSERT=1 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:30:28.297817 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b032b712-f22b-41e8-b91f-a07f97c05220 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Action: 'create', calling method: .version_select at 0x7fd7a0671040>, body: {"keypair": {"name": "tempest-TestShelveInstance-309170775", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdovgxjhfH4f1E6CYItDuVOvwVb5jX7QmIdUvA4LrI+E+MLSXTDDFGZFOz08+1ymJoHvyQBhzy7qJCK1eE6GZXm0N+VzLTVzLL/fDGvyts8SiGXQTVmhRoqL/h5j/35aA=="}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:30:28.313084 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-b032b712-f22b-41e8-b91f-a07f97c05220 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Getting quotas for project 62a064d446ad4feea4888963e9db6511. Resources: {'key_pairs'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 17:30:28.317306 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-b032b712-f22b-41e8-b91f-a07f97c05220 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Getting quotas for user fcbe18db4b734d26b1820f0c2928b571 and project 62a064d446ad4feea4888963e9db6511. Resources: {'key_pairs'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 17:30:28.342979 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b032b712-f22b-41e8-b91f-a07f97c05220 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.247347 May 23 17:30:28.348119 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 512/1006] 10.222.0.46 () {60 vars in 1158 bytes} [Mon May 23 17:30:28 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:30:43.521444 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:30:43.522190 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:30:43.526501 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ac26521b-b508-4a6f-a70e-1d9b8b0a0f97 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-72252998", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-309170775", "security_groups": [{"name": "tempest-secgroup-smoke-1149424234"}], "networks": [{"uuid": "0f08b8e3-c33f-4f01-b7e8-6e00f2ba65e7"}], "block_device_mapping_v2": [{"uuid": "6f2797e9-b366-44ff-83e2-8f2751fa0623", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:30:43.644569 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.network.neutron [None req-ac26521b-b508-4a6f-a70e-1d9b8b0a0f97 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] validate_networks() for [('0f08b8e3-c33f-4f01-b7e8-6e00f2ba65e7', None, None, None, None, None)] {{(pid=117909) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 17:30:44.151765 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-ac26521b-b508-4a6f-a70e-1d9b8b0a0f97 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Flavor limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 17:30:44.152467 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-ac26521b-b508-4a6f-a70e-1d9b8b0a0f97 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Image limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 17:30:44.153226 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-ac26521b-b508-4a6f-a70e-1d9b8b0a0f97 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Flavor pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 17:30:44.153859 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-ac26521b-b508-4a6f-a70e-1d9b8b0a0f97 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Image pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 17:30:44.154488 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-ac26521b-b508-4a6f-a70e-1d9b8b0a0f97 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 17:30:44.168642 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ac26521b-b508-4a6f-a70e-1d9b8b0a0f97 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:30:44.169277 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ac26521b-b508-4a6f-a70e-1d9b8b0a0f97 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:30:44.170470 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ac26521b-b508-4a6f-a70e-1d9b8b0a0f97 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:30:44.171090 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ac26521b-b508-4a6f-a70e-1d9b8b0a0f97 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:30:44.188490 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-ac26521b-b508-4a6f-a70e-1d9b8b0a0f97 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Getting quotas for project 62a064d446ad4feea4888963e9db6511. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 17:30:44.192855 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-ac26521b-b508-4a6f-a70e-1d9b8b0a0f97 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Getting quotas for user fcbe18db4b734d26b1820f0c2928b571 and project 62a064d446ad4feea4888963e9db6511. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 17:30:44.255226 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ac26521b-b508-4a6f-a70e-1d9b8b0a0f97 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Going to run 1 instances... {{(pid=117909) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 17:30:44.257372 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ac26521b-b508-4a6f-a70e-1d9b8b0a0f97 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6f2797e9-b366-44ff-83e2-8f2751fa0623',volume_size=None,volume_type=None)] {{(pid=117909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 17:30:44.396811 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ac26521b-b508-4a6f-a70e-1d9b8b0a0f97 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.877188 May 23 17:30:44.397487 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 495/1007] 10.222.0.46 () {60 vars in 1146 bytes} [Mon May 23 17:30:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 17:30:44.407643 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-ee9712ac-f0aa-4cd6-bee2-01ee9d397402 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:30:44.408311 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-ee9712ac-f0aa-4cd6-bee2-01ee9d397402 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:30:44.410898 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=4 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:30:44.411542 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:30:44.468747 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ee9712ac-f0aa-4cd6-bee2-01ee9d397402 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbe18db4b734d26b1820f0c2928b571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a064d446ad4feea4888963e9db6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:30:44.476742 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-ee9712ac-f0aa-4cd6-bee2-01ee9d397402 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8" status: 200 len: 1086 microversion: 2.1 time: 0.073039 May 23 17:30:44.477299 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 513/1008] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:30:44 2022] GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8 => generated 1086 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:30:45.494794 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-000f86b4-70ab-4128-9ac4-c54f4b495f8b tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:30:45.495426 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-000f86b4-70ab-4128-9ac4-c54f4b495f8b tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:30:45.502945 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-000f86b4-70ab-4128-9ac4-c54f4b495f8b tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:30:45.503511 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-000f86b4-70ab-4128-9ac4-c54f4b495f8b tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:30:45.504401 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-000f86b4-70ab-4128-9ac4-c54f4b495f8b tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:30:45.504930 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-000f86b4-70ab-4128-9ac4-c54f4b495f8b tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:30:45.578001 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-000f86b4-70ab-4128-9ac4-c54f4b495f8b tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbe18db4b734d26b1820f0c2928b571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a064d446ad4feea4888963e9db6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:30:45.585865 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-000f86b4-70ab-4128-9ac4-c54f4b495f8b tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8" status: 200 len: 1192 microversion: 2.1 time: 0.095640 May 23 17:30:45.592657 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 496/1009] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:30:45 2022] GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8 => generated 1192 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:30:46.603329 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-f0e77694-1bdb-4dd0-97e8-779f4f7f854e tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:30:46.603905 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-f0e77694-1bdb-4dd0-97e8-779f4f7f854e tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:30:46.611210 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f0e77694-1bdb-4dd0-97e8-779f4f7f854e tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:30:46.611657 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f0e77694-1bdb-4dd0-97e8-779f4f7f854e tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:30:46.612476 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f0e77694-1bdb-4dd0-97e8-779f4f7f854e tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:30:46.612939 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f0e77694-1bdb-4dd0-97e8-779f4f7f854e tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:30:46.852850 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-f0e77694-1bdb-4dd0-97e8-779f4f7f854e tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbe18db4b734d26b1820f0c2928b571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a064d446ad4feea4888963e9db6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:30:46.861448 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-f0e77694-1bdb-4dd0-97e8-779f4f7f854e tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8" status: 200 len: 1258 microversion: 2.1 time: 0.262076 May 23 17:30:46.861904 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 514/1010] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:30:46 2022] GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8 => generated 1258 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:30:46.997597 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-35c94856-26c5-4c29-9f8d-65c0d8ea1e9a req-33aa8570-e144-464f-8c6a-f6b7647a0a7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94a1d0ba-52d2-48de-83f9-1a391987dab8", "tag": "9abe54ee-d2b3-4019-b6b9-ade3640e3235"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:30:47.013729 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-35c94856-26c5-4c29-9f8d-65c0d8ea1e9a req-33aa8570-e144-464f-8c6a-f6b7647a0a7b service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:30:47.014104 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-35c94856-26c5-4c29-9f8d-65c0d8ea1e9a req-33aa8570-e144-464f-8c6a-f6b7647a0a7b service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:30:47.050949 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-35c94856-26c5-4c29-9f8d-65c0d8ea1e9a req-33aa8570-e144-464f-8c6a-f6b7647a0a7b service nova] Creating event network-changed:9abe54ee-d2b3-4019-b6b9-ade3640e3235 for instance 94a1d0ba-52d2-48de-83f9-1a391987dab8 on hv-cinder-84299 May 23 17:30:47.059104 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-35c94856-26c5-4c29-9f8d-65c0d8ea1e9a req-33aa8570-e144-464f-8c6a-f6b7647a0a7b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065524 May 23 17:30:47.059969 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 497/1011] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:30:47.878722 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-3a46ae55-2456-4368-983c-ff8b92255866 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:30:47.879422 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-3a46ae55-2456-4368-983c-ff8b92255866 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:30:47.886829 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3a46ae55-2456-4368-983c-ff8b92255866 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:30:47.887274 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3a46ae55-2456-4368-983c-ff8b92255866 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:30:47.888052 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3a46ae55-2456-4368-983c-ff8b92255866 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:30:47.888488 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3a46ae55-2456-4368-983c-ff8b92255866 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:30:48.098374 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-3a46ae55-2456-4368-983c-ff8b92255866 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbe18db4b734d26b1820f0c2928b571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a064d446ad4feea4888963e9db6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:30:48.107133 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-3a46ae55-2456-4368-983c-ff8b92255866 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8" status: 200 len: 1258 microversion: 2.1 time: 0.232361 May 23 17:30:48.107747 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 515/1012] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:30:47 2022] GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8 => generated 1258 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:30:49.124197 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-70a426f5-d89b-4f38-bfa9-3de83b9d062f tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:30:49.124908 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-70a426f5-d89b-4f38-bfa9-3de83b9d062f tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:30:49.132078 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-70a426f5-d89b-4f38-bfa9-3de83b9d062f tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:30:49.132524 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-70a426f5-d89b-4f38-bfa9-3de83b9d062f tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:30:49.133326 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-70a426f5-d89b-4f38-bfa9-3de83b9d062f tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:30:49.133756 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-70a426f5-d89b-4f38-bfa9-3de83b9d062f tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:30:49.273531 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-70a426f5-d89b-4f38-bfa9-3de83b9d062f tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbe18db4b734d26b1820f0c2928b571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a064d446ad4feea4888963e9db6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:30:49.281385 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-70a426f5-d89b-4f38-bfa9-3de83b9d062f tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8" status: 200 len: 1258 microversion: 2.1 time: 0.161465 May 23 17:30:49.281952 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 498/1013] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:30:49 2022] GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8 => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:30:50.298753 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-af1a6a2b-1363-4ddc-aad8-9e6f296f854d tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:30:50.299353 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-af1a6a2b-1363-4ddc-aad8-9e6f296f854d tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:30:50.306581 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-af1a6a2b-1363-4ddc-aad8-9e6f296f854d tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:30:50.307033 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-af1a6a2b-1363-4ddc-aad8-9e6f296f854d tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:30:50.307816 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-af1a6a2b-1363-4ddc-aad8-9e6f296f854d tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:30:50.308252 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-af1a6a2b-1363-4ddc-aad8-9e6f296f854d tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:30:50.439277 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-af1a6a2b-1363-4ddc-aad8-9e6f296f854d tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbe18db4b734d26b1820f0c2928b571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a064d446ad4feea4888963e9db6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:30:50.448797 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-af1a6a2b-1363-4ddc-aad8-9e6f296f854d tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8" status: 200 len: 1258 microversion: 2.1 time: 0.153864 May 23 17:30:50.449383 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 516/1014] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:30:50 2022] GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:30:51.466467 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-91089330-3e32-4513-a90b-6f61d570c8d0 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:30:51.467234 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-91089330-3e32-4513-a90b-6f61d570c8d0 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:30:51.474227 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-91089330-3e32-4513-a90b-6f61d570c8d0 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:30:51.474676 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-91089330-3e32-4513-a90b-6f61d570c8d0 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:30:51.475449 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-91089330-3e32-4513-a90b-6f61d570c8d0 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:30:51.476023 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-91089330-3e32-4513-a90b-6f61d570c8d0 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:30:51.615530 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-91089330-3e32-4513-a90b-6f61d570c8d0 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbe18db4b734d26b1820f0c2928b571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a064d446ad4feea4888963e9db6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:30:51.623389 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-91089330-3e32-4513-a90b-6f61d570c8d0 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8" status: 200 len: 1258 microversion: 2.1 time: 0.160906 May 23 17:30:51.624654 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 499/1015] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:30:51 2022] GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8 => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:30:52.640683 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b81acad9-a06b-4d81-a507-580f2ab4c194 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:30:52.641293 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-b81acad9-a06b-4d81-a507-580f2ab4c194 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:30:52.648441 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b81acad9-a06b-4d81-a507-580f2ab4c194 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:30:52.648939 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b81acad9-a06b-4d81-a507-580f2ab4c194 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:30:52.649757 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b81acad9-a06b-4d81-a507-580f2ab4c194 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:30:52.650196 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b81acad9-a06b-4d81-a507-580f2ab4c194 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:30:52.786802 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b81acad9-a06b-4d81-a507-580f2ab4c194 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbe18db4b734d26b1820f0c2928b571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a064d446ad4feea4888963e9db6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:30:52.793692 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b81acad9-a06b-4d81-a507-580f2ab4c194 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8" status: 200 len: 1258 microversion: 2.1 time: 0.157441 May 23 17:30:52.794471 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 517/1016] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:30:52 2022] GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:30:53.810046 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-846ad3b5-1cda-466e-b079-ea9d90b550fe tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:30:53.810663 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-846ad3b5-1cda-466e-b079-ea9d90b550fe tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:30:53.817392 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-846ad3b5-1cda-466e-b079-ea9d90b550fe tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:30:53.817835 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-846ad3b5-1cda-466e-b079-ea9d90b550fe tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:30:53.818569 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-846ad3b5-1cda-466e-b079-ea9d90b550fe tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:30:53.819001 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-846ad3b5-1cda-466e-b079-ea9d90b550fe tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:30:53.951179 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-846ad3b5-1cda-466e-b079-ea9d90b550fe tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbe18db4b734d26b1820f0c2928b571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a064d446ad4feea4888963e9db6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:30:53.958784 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-846ad3b5-1cda-466e-b079-ea9d90b550fe tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8" status: 200 len: 1258 microversion: 2.1 time: 0.152841 May 23 17:30:53.959543 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 500/1017] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:30:53 2022] GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8 => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:30:54.979746 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-0212cfbe-fee2-4f16-a0e7-9c19c64a64ac tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:30:54.980797 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-0212cfbe-fee2-4f16-a0e7-9c19c64a64ac tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:30:54.984484 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=2 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:30:54.993670 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0212cfbe-fee2-4f16-a0e7-9c19c64a64ac tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:30:54.994410 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0212cfbe-fee2-4f16-a0e7-9c19c64a64ac tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:30:54.995662 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0212cfbe-fee2-4f16-a0e7-9c19c64a64ac tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:30:54.996387 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0212cfbe-fee2-4f16-a0e7-9c19c64a64ac tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:30:55.152139 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-0212cfbe-fee2-4f16-a0e7-9c19c64a64ac tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbe18db4b734d26b1820f0c2928b571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a064d446ad4feea4888963e9db6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:30:55.159881 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-0212cfbe-fee2-4f16-a0e7-9c19c64a64ac tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8" status: 200 len: 1258 microversion: 2.1 time: 0.186695 May 23 17:30:55.160458 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 518/1018] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:30:54 2022] GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8 => generated 1258 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:30:56.181787 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ca48388f-6454-4d5e-a036-3cc357665c9f tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:30:56.182614 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ca48388f-6454-4d5e-a036-3cc357665c9f tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:30:56.185522 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=2 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:30:56.186591 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=6 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:30:56.197085 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ca48388f-6454-4d5e-a036-3cc357665c9f tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:30:56.197771 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ca48388f-6454-4d5e-a036-3cc357665c9f tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:30:56.199015 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ca48388f-6454-4d5e-a036-3cc357665c9f tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:30:56.199716 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ca48388f-6454-4d5e-a036-3cc357665c9f tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:30:56.336160 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ca48388f-6454-4d5e-a036-3cc357665c9f tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbe18db4b734d26b1820f0c2928b571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a064d446ad4feea4888963e9db6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:30:56.347663 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ca48388f-6454-4d5e-a036-3cc357665c9f tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8" status: 200 len: 1258 microversion: 2.1 time: 0.172555 May 23 17:30:56.348205 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 501/1019] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:30:56 2022] GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8 => generated 1258 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:30:57.368899 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e9353e56-d540-4e73-87e8-c7e8a9225416 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:30:57.370194 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-e9353e56-d540-4e73-87e8-c7e8a9225416 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:30:57.376571 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e9353e56-d540-4e73-87e8-c7e8a9225416 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:30:57.377050 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e9353e56-d540-4e73-87e8-c7e8a9225416 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:30:57.377814 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e9353e56-d540-4e73-87e8-c7e8a9225416 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:30:57.378247 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e9353e56-d540-4e73-87e8-c7e8a9225416 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:30:57.523174 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-e9929d64-57df-485d-9a10-fe578971a264 req-17b61e08-a739-49a3-bac4-57a20efa4ebb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94a1d0ba-52d2-48de-83f9-1a391987dab8", "name": "network-vif-plugged", "status": "completed", "tag": "9abe54ee-d2b3-4019-b6b9-ade3640e3235"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:30:57.526808 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e9353e56-d540-4e73-87e8-c7e8a9225416 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbe18db4b734d26b1820f0c2928b571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a064d446ad4feea4888963e9db6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:30:57.531760 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-e9929d64-57df-485d-9a10-fe578971a264 req-17b61e08-a739-49a3-bac4-57a20efa4ebb service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:30:57.532633 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-e9929d64-57df-485d-9a10-fe578971a264 req-17b61e08-a739-49a3-bac4-57a20efa4ebb service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:30:57.534509 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-e9353e56-d540-4e73-87e8-c7e8a9225416 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8" status: 200 len: 1258 microversion: 2.1 time: 0.169589 May 23 17:30:57.535080 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 519/1020] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:30:57 2022] GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8 => generated 1258 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:30:57.544475 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-e9929d64-57df-485d-9a10-fe578971a264 req-17b61e08-a739-49a3-bac4-57a20efa4ebb service nova] Creating event network-vif-plugged:9abe54ee-d2b3-4019-b6b9-ade3640e3235 for instance 94a1d0ba-52d2-48de-83f9-1a391987dab8 on hv-cinder-84299 May 23 17:30:57.550548 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-e9929d64-57df-485d-9a10-fe578971a264 req-17b61e08-a739-49a3-bac4-57a20efa4ebb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119055 May 23 17:30:57.551363 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 502/1021] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:30:58.553984 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-edccb22b-424a-4d3b-8a96-828f5c456516 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:30:58.554721 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-edccb22b-424a-4d3b-8a96-828f5c456516 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:30:58.572584 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-edccb22b-424a-4d3b-8a96-828f5c456516 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:30:58.573184 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-edccb22b-424a-4d3b-8a96-828f5c456516 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:30:58.574148 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-edccb22b-424a-4d3b-8a96-828f5c456516 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:30:58.574699 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-edccb22b-424a-4d3b-8a96-828f5c456516 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:30:58.715226 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-edccb22b-424a-4d3b-8a96-828f5c456516 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbe18db4b734d26b1820f0c2928b571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a064d446ad4feea4888963e9db6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:30:58.723119 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-edccb22b-424a-4d3b-8a96-828f5c456516 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8" status: 200 len: 1258 microversion: 2.1 time: 0.174229 May 23 17:30:58.723704 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 520/1022] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:30:58 2022] GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8 => generated 1258 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:30:59.745333 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-30c4d970-7d42-4ab0-ab97-8326090675a4 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:30:59.746551 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-30c4d970-7d42-4ab0-ab97-8326090675a4 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:30:59.754991 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-30c4d970-7d42-4ab0-ab97-8326090675a4 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:30:59.755403 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-30c4d970-7d42-4ab0-ab97-8326090675a4 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:30:59.756165 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-30c4d970-7d42-4ab0-ab97-8326090675a4 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:30:59.756595 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-30c4d970-7d42-4ab0-ab97-8326090675a4 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:30:59.894585 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-30c4d970-7d42-4ab0-ab97-8326090675a4 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbe18db4b734d26b1820f0c2928b571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a064d446ad4feea4888963e9db6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:30:59.906677 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-30c4d970-7d42-4ab0-ab97-8326090675a4 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8" status: 200 len: 1441 microversion: 2.1 time: 0.168691 May 23 17:30:59.907468 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 503/1023] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:30:59 2022] GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8 => generated 1441 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:30:59.928335 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-ec1c6d2c-7378-47fb-94da-e60620c33907 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:30:59.928982 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-ec1c6d2c-7378-47fb-94da-e60620c33907 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:30:59.936058 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ec1c6d2c-7378-47fb-94da-e60620c33907 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:30:59.936513 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ec1c6d2c-7378-47fb-94da-e60620c33907 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:30:59.937322 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ec1c6d2c-7378-47fb-94da-e60620c33907 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:30:59.937761 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ec1c6d2c-7378-47fb-94da-e60620c33907 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:31:00.073907 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ec1c6d2c-7378-47fb-94da-e60620c33907 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbe18db4b734d26b1820f0c2928b571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a064d446ad4feea4888963e9db6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:31:00.082551 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-ec1c6d2c-7378-47fb-94da-e60620c33907 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8" status: 200 len: 1441 microversion: 2.1 time: 0.158202 May 23 17:31:00.083130 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 521/1024] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:30:59 2022] GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8 => generated 1441 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:31:02.058869 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-548c0168-9051-422b-9530-dad732ba7868 req-7d95d0f5-9844-43ec-b384-9f16ccdf6581 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94a1d0ba-52d2-48de-83f9-1a391987dab8", "tag": "9abe54ee-d2b3-4019-b6b9-ade3640e3235"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:31:02.067321 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-548c0168-9051-422b-9530-dad732ba7868 req-7d95d0f5-9844-43ec-b384-9f16ccdf6581 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:31:02.067761 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-548c0168-9051-422b-9530-dad732ba7868 req-7d95d0f5-9844-43ec-b384-9f16ccdf6581 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:31:02.078918 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-548c0168-9051-422b-9530-dad732ba7868 req-7d95d0f5-9844-43ec-b384-9f16ccdf6581 service nova] Creating event network-changed:9abe54ee-d2b3-4019-b6b9-ade3640e3235 for instance 94a1d0ba-52d2-48de-83f9-1a391987dab8 on hv-cinder-84299 May 23 17:31:02.084216 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-548c0168-9051-422b-9530-dad732ba7868 req-7d95d0f5-9844-43ec-b384-9f16ccdf6581 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028996 May 23 17:31:02.084925 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 504/1025] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:31:03.975857 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 17:31:03.975857 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Mon May 23 17:31:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 17:31:14.567418 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 17:31:14.567948 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Mon May 23 17:31:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 17:31:23.897498 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 17:31:23.898500 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Mon May 23 17:31:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 17:32:32.478851 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 17:32:32.479909 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Mon May 23 17:32:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 17:32:56.441389 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=20 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:32:56.442565 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=48 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:32:56.447682 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-dca9d50e-1091-4079-a0dd-dc32fd1f235d tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:32:56.448220 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-dca9d50e-1091-4079-a0dd-dc32fd1f235d tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:32:56.455318 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-dca9d50e-1091-4079-a0dd-dc32fd1f235d tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:32:56.455768 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-dca9d50e-1091-4079-a0dd-dc32fd1f235d tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:32:56.458194 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-dca9d50e-1091-4079-a0dd-dc32fd1f235d tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:32:56.458194 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-dca9d50e-1091-4079-a0dd-dc32fd1f235d tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:32:56.482174 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.objects.instance [None req-dca9d50e-1091-4079-a0dd-dc32fd1f235d tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lazy-loading 'flavor' on Instance uuid 94a1d0ba-52d2-48de-83f9-1a391987dab8 {{(pid=117910) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 17:32:56.560554 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-dca9d50e-1091-4079-a0dd-dc32fd1f235d tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "POST /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8/action" status: 202 len: 0 microversion: 2.1 time: 0.122311 May 23 17:32:56.561169 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 522/1026] 10.222.0.46 () {60 vars in 1277 bytes} [Mon May 23 17:32:56 2022] POST /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 17:32:56.567925 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f2cf645f-34a5-43a9-913c-c387ddb634c0] AMQP server on 10.222.0.46:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 23 17:32:56.568554 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:32:56.569320 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=44 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:32:56.573501 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-fbea1a6d-4893-4712-9571-19d86177c15c tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:32:56.574209 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-fbea1a6d-4893-4712-9571-19d86177c15c tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:32:56.581850 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fbea1a6d-4893-4712-9571-19d86177c15c tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:32:56.582308 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fbea1a6d-4893-4712-9571-19d86177c15c tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:32:56.583079 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fbea1a6d-4893-4712-9571-19d86177c15c tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:32:56.583518 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fbea1a6d-4893-4712-9571-19d86177c15c tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:32:56.781145 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-fbea1a6d-4893-4712-9571-19d86177c15c tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbe18db4b734d26b1820f0c2928b571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a064d446ad4feea4888963e9db6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:32:56.789239 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-fbea1a6d-4893-4712-9571-19d86177c15c tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8" status: 200 len: 1565 microversion: 2.1 time: 0.223557 May 23 17:32:56.789813 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 505/1027] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:32:56 2022] GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8 => generated 1565 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:32:57.812933 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-1c3a4f02-ba9f-4769-b15e-27c747f35ce5 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:32:57.814071 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-1c3a4f02-ba9f-4769-b15e-27c747f35ce5 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:32:57.823235 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1c3a4f02-ba9f-4769-b15e-27c747f35ce5 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:32:57.823769 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1c3a4f02-ba9f-4769-b15e-27c747f35ce5 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:32:57.824533 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1c3a4f02-ba9f-4769-b15e-27c747f35ce5 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:32:57.824993 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1c3a4f02-ba9f-4769-b15e-27c747f35ce5 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:32:58.020308 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-1c3a4f02-ba9f-4769-b15e-27c747f35ce5 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbe18db4b734d26b1820f0c2928b571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a064d446ad4feea4888963e9db6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:32:58.028294 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-1c3a4f02-ba9f-4769-b15e-27c747f35ce5 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8" status: 200 len: 1565 microversion: 2.1 time: 0.223712 May 23 17:32:58.028930 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 523/1028] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:32:57 2022] GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8 => generated 1565 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:32:59.049524 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e89bc406-5937-4b51-a45f-94db1c86c055 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:32:59.050338 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e89bc406-5937-4b51-a45f-94db1c86c055 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:32:59.059891 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e89bc406-5937-4b51-a45f-94db1c86c055 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:32:59.060264 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e89bc406-5937-4b51-a45f-94db1c86c055 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:32:59.061061 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e89bc406-5937-4b51-a45f-94db1c86c055 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:32:59.061497 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e89bc406-5937-4b51-a45f-94db1c86c055 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:32:59.069050 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO oslo.messaging._drivers.impl_rabbit [-] [f2cf645f-34a5-43a9-913c-c387ddb634c0] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 34786. May 23 17:32:59.194906 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e89bc406-5937-4b51-a45f-94db1c86c055 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbe18db4b734d26b1820f0c2928b571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a064d446ad4feea4888963e9db6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:32:59.202872 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e89bc406-5937-4b51-a45f-94db1c86c055 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8" status: 200 len: 1565 microversion: 2.1 time: 0.159927 May 23 17:32:59.203427 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 506/1029] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:32:59 2022] GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8 => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:33:00.229473 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-053c1aba-d716-4605-9c01-4f95eb3cec21 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:33:00.230534 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-053c1aba-d716-4605-9c01-4f95eb3cec21 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:33:00.241548 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-053c1aba-d716-4605-9c01-4f95eb3cec21 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:33:00.242303 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-053c1aba-d716-4605-9c01-4f95eb3cec21 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:33:00.243575 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-053c1aba-d716-4605-9c01-4f95eb3cec21 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:33:00.244295 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-053c1aba-d716-4605-9c01-4f95eb3cec21 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:33:00.384627 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-053c1aba-d716-4605-9c01-4f95eb3cec21 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbe18db4b734d26b1820f0c2928b571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a064d446ad4feea4888963e9db6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:33:00.392633 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-053c1aba-d716-4605-9c01-4f95eb3cec21 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8" status: 200 len: 1565 microversion: 2.1 time: 0.169958 May 23 17:33:00.393229 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 524/1030] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:33:00 2022] GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8 => generated 1565 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:33:01.414181 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-13546d37-0ec8-4864-b30e-8f66033dde78 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:33:01.414786 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-13546d37-0ec8-4864-b30e-8f66033dde78 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:33:01.421841 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-13546d37-0ec8-4864-b30e-8f66033dde78 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:33:01.422296 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-13546d37-0ec8-4864-b30e-8f66033dde78 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:33:01.423073 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-13546d37-0ec8-4864-b30e-8f66033dde78 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:33:01.423512 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-13546d37-0ec8-4864-b30e-8f66033dde78 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:33:01.572904 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-13546d37-0ec8-4864-b30e-8f66033dde78 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbe18db4b734d26b1820f0c2928b571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a064d446ad4feea4888963e9db6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:33:01.581803 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-13546d37-0ec8-4864-b30e-8f66033dde78 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8" status: 200 len: 1565 microversion: 2.1 time: 0.174288 May 23 17:33:01.582402 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 507/1031] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:33:01 2022] GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8 => generated 1565 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:33:02.603205 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-cfc4758e-db5a-4049-a7b9-d451e92eedd6 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:33:02.604243 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-cfc4758e-db5a-4049-a7b9-d451e92eedd6 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:33:02.615303 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cfc4758e-db5a-4049-a7b9-d451e92eedd6 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:33:02.616055 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cfc4758e-db5a-4049-a7b9-d451e92eedd6 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:33:02.617370 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cfc4758e-db5a-4049-a7b9-d451e92eedd6 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:33:02.618092 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cfc4758e-db5a-4049-a7b9-d451e92eedd6 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:33:02.768923 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-cfc4758e-db5a-4049-a7b9-d451e92eedd6 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbe18db4b734d26b1820f0c2928b571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a064d446ad4feea4888963e9db6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:33:02.778439 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-cfc4758e-db5a-4049-a7b9-d451e92eedd6 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8" status: 200 len: 1565 microversion: 2.1 time: 0.181738 May 23 17:33:02.779003 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 525/1032] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:33:02 2022] GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8 => generated 1565 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:33:03.797007 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2405521c-fcbc-4e0e-8648-52c1bfecf7df tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:33:03.797607 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2405521c-fcbc-4e0e-8648-52c1bfecf7df tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:33:03.804530 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2405521c-fcbc-4e0e-8648-52c1bfecf7df tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:33:03.805029 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2405521c-fcbc-4e0e-8648-52c1bfecf7df tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:33:03.805810 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2405521c-fcbc-4e0e-8648-52c1bfecf7df tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:33:03.806252 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2405521c-fcbc-4e0e-8648-52c1bfecf7df tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:33:03.935555 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2405521c-fcbc-4e0e-8648-52c1bfecf7df tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbe18db4b734d26b1820f0c2928b571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a064d446ad4feea4888963e9db6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:33:03.943583 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2405521c-fcbc-4e0e-8648-52c1bfecf7df tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8" status: 200 len: 1565 microversion: 2.1 time: 0.151335 May 23 17:33:03.944170 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 508/1033] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:33:03 2022] GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8 => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:33:04.961395 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-070ff2f4-46e3-4db7-9fc9-6772c90d7ed0 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:33:04.962011 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-070ff2f4-46e3-4db7-9fc9-6772c90d7ed0 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:33:04.969037 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-070ff2f4-46e3-4db7-9fc9-6772c90d7ed0 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:33:04.969505 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-070ff2f4-46e3-4db7-9fc9-6772c90d7ed0 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:33:04.970268 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-070ff2f4-46e3-4db7-9fc9-6772c90d7ed0 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:33:04.970702 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-070ff2f4-46e3-4db7-9fc9-6772c90d7ed0 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:33:05.104474 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-070ff2f4-46e3-4db7-9fc9-6772c90d7ed0 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbe18db4b734d26b1820f0c2928b571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a064d446ad4feea4888963e9db6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:33:05.113915 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-070ff2f4-46e3-4db7-9fc9-6772c90d7ed0 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8" status: 200 len: 1565 microversion: 2.1 time: 0.156376 May 23 17:33:05.114471 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 526/1034] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:33:04 2022] GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:33:06.139229 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-bfef1a29-9641-4c68-a53e-3a860d907c88 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:33:06.139845 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-bfef1a29-9641-4c68-a53e-3a860d907c88 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:33:06.146842 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bfef1a29-9641-4c68-a53e-3a860d907c88 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:33:06.147297 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bfef1a29-9641-4c68-a53e-3a860d907c88 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:33:06.148071 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bfef1a29-9641-4c68-a53e-3a860d907c88 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:33:06.148531 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bfef1a29-9641-4c68-a53e-3a860d907c88 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:33:06.288668 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-bfef1a29-9641-4c68-a53e-3a860d907c88 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbe18db4b734d26b1820f0c2928b571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a064d446ad4feea4888963e9db6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:33:06.298755 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-bfef1a29-9641-4c68-a53e-3a860d907c88 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8" status: 200 len: 1565 microversion: 2.1 time: 0.165708 May 23 17:33:06.299335 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 509/1035] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:33:06 2022] GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8 => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:33:07.315726 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-117e5de9-1570-4131-a767-bc41981f825f tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:33:07.316343 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-117e5de9-1570-4131-a767-bc41981f825f tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:33:07.323423 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-117e5de9-1570-4131-a767-bc41981f825f tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:33:07.323868 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-117e5de9-1570-4131-a767-bc41981f825f tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:33:07.324660 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-117e5de9-1570-4131-a767-bc41981f825f tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:33:07.325143 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-117e5de9-1570-4131-a767-bc41981f825f tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:33:07.459775 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-117e5de9-1570-4131-a767-bc41981f825f tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbe18db4b734d26b1820f0c2928b571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a064d446ad4feea4888963e9db6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:33:07.467692 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-117e5de9-1570-4131-a767-bc41981f825f tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8" status: 200 len: 1565 microversion: 2.1 time: 0.155927 May 23 17:33:07.468261 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 527/1036] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:33:07 2022] GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:33:07.833917 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 17:33:07.834361 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Mon May 23 17:33:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 17:33:08.489876 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c756f82d-9e8f-4ed3-88bf-a857b39eed5c tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:33:08.490895 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c756f82d-9e8f-4ed3-88bf-a857b39eed5c tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:33:08.500179 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c756f82d-9e8f-4ed3-88bf-a857b39eed5c tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:33:08.500639 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c756f82d-9e8f-4ed3-88bf-a857b39eed5c tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:33:08.501409 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c756f82d-9e8f-4ed3-88bf-a857b39eed5c tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:33:08.501870 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c756f82d-9e8f-4ed3-88bf-a857b39eed5c tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:33:08.639970 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c756f82d-9e8f-4ed3-88bf-a857b39eed5c tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbe18db4b734d26b1820f0c2928b571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a064d446ad4feea4888963e9db6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:33:08.652212 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c756f82d-9e8f-4ed3-88bf-a857b39eed5c tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8" status: 200 len: 1565 microversion: 2.1 time: 0.168778 May 23 17:33:08.653168 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 510/1037] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:33:08 2022] GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8 => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:33:09.672805 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e2e6d3f2-ea08-4a35-aed1-376bbf8a7d88 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:33:09.673535 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-e2e6d3f2-ea08-4a35-aed1-376bbf8a7d88 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:33:09.682473 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e2e6d3f2-ea08-4a35-aed1-376bbf8a7d88 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:33:09.683009 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e2e6d3f2-ea08-4a35-aed1-376bbf8a7d88 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:33:09.684008 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e2e6d3f2-ea08-4a35-aed1-376bbf8a7d88 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:33:09.684646 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e2e6d3f2-ea08-4a35-aed1-376bbf8a7d88 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:33:09.823090 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e2e6d3f2-ea08-4a35-aed1-376bbf8a7d88 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbe18db4b734d26b1820f0c2928b571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a064d446ad4feea4888963e9db6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:33:09.831105 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-e2e6d3f2-ea08-4a35-aed1-376bbf8a7d88 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8" status: 200 len: 1506 microversion: 2.1 time: 0.163851 May 23 17:33:09.831680 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 528/1038] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:33:09 2022] GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8 => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:33:09.847522 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4a4f8758-d478-41a0-8281-4bebaea246f4 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:33:09.848100 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4a4f8758-d478-41a0-8281-4bebaea246f4 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:33:09.854779 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4a4f8758-d478-41a0-8281-4bebaea246f4 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:33:09.855268 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4a4f8758-d478-41a0-8281-4bebaea246f4 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:33:09.856036 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4a4f8758-d478-41a0-8281-4bebaea246f4 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:33:09.856479 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4a4f8758-d478-41a0-8281-4bebaea246f4 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:33:09.948038 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4a4f8758-d478-41a0-8281-4bebaea246f4 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "POST /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8/action" status: 202 len: 0 microversion: 2.1 time: 0.104306 May 23 17:33:09.948815 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 511/1039] 10.222.0.46 () {60 vars in 1277 bytes} [Mon May 23 17:33:09 2022] POST /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 17:33:09.957224 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c55e75a9-aea0-453a-a3d0-f46ee4411ba3 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:33:09.957928 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c55e75a9-aea0-453a-a3d0-f46ee4411ba3 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:33:09.964551 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c55e75a9-aea0-453a-a3d0-f46ee4411ba3 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:33:09.965036 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c55e75a9-aea0-453a-a3d0-f46ee4411ba3 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:33:09.965817 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c55e75a9-aea0-453a-a3d0-f46ee4411ba3 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:33:09.966265 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c55e75a9-aea0-453a-a3d0-f46ee4411ba3 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:33:10.096772 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-c55e75a9-aea0-453a-a3d0-f46ee4411ba3 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbe18db4b734d26b1820f0c2928b571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a064d446ad4feea4888963e9db6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:33:10.104922 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c55e75a9-aea0-453a-a3d0-f46ee4411ba3 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8" status: 200 len: 1514 microversion: 2.1 time: 0.151583 May 23 17:33:10.105495 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 529/1040] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:33:09 2022] GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:33:11.123446 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-47311290-b252-47ae-acb2-ab92905e82fe tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:33:11.125157 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-47311290-b252-47ae-acb2-ab92905e82fe tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:33:11.130489 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-47311290-b252-47ae-acb2-ab92905e82fe tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:33:11.130939 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-47311290-b252-47ae-acb2-ab92905e82fe tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:33:11.131702 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-47311290-b252-47ae-acb2-ab92905e82fe tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:33:11.132133 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-47311290-b252-47ae-acb2-ab92905e82fe tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:33:11.273262 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-47311290-b252-47ae-acb2-ab92905e82fe tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbe18db4b734d26b1820f0c2928b571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a064d446ad4feea4888963e9db6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:33:11.286185 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-47311290-b252-47ae-acb2-ab92905e82fe tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8" status: 200 len: 1572 microversion: 2.1 time: 0.167222 May 23 17:33:11.286834 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 512/1041] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:33:11 2022] GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8 => generated 1572 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:33:12.155872 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-7628b00f-2b97-4920-a006-3021ee387cd6 req-64c0cd78-36d3-4a8e-85b8-c691778a834c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94a1d0ba-52d2-48de-83f9-1a391987dab8", "name": "network-vif-unplugged", "status": "completed", "tag": "9abe54ee-d2b3-4019-b6b9-ade3640e3235"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:33:12.165269 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-7628b00f-2b97-4920-a006-3021ee387cd6 req-64c0cd78-36d3-4a8e-85b8-c691778a834c service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:33:12.166164 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-7628b00f-2b97-4920-a006-3021ee387cd6 req-64c0cd78-36d3-4a8e-85b8-c691778a834c service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:33:12.177790 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-7628b00f-2b97-4920-a006-3021ee387cd6 req-64c0cd78-36d3-4a8e-85b8-c691778a834c service nova] Creating event network-vif-unplugged:9abe54ee-d2b3-4019-b6b9-ade3640e3235 for instance 94a1d0ba-52d2-48de-83f9-1a391987dab8 on hv-cinder-84299 May 23 17:33:12.182719 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-7628b00f-2b97-4920-a006-3021ee387cd6 req-64c0cd78-36d3-4a8e-85b8-c691778a834c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030756 May 23 17:33:12.183519 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 530/1042] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:33:12.306054 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ed907f4d-01a0-4b3d-8907-ebf00bd859a9 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:33:12.306924 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ed907f4d-01a0-4b3d-8907-ebf00bd859a9 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:33:12.315107 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ed907f4d-01a0-4b3d-8907-ebf00bd859a9 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:33:12.315550 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ed907f4d-01a0-4b3d-8907-ebf00bd859a9 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:33:12.316316 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ed907f4d-01a0-4b3d-8907-ebf00bd859a9 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:33:12.316795 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ed907f4d-01a0-4b3d-8907-ebf00bd859a9 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:33:12.450738 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ed907f4d-01a0-4b3d-8907-ebf00bd859a9 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbe18db4b734d26b1820f0c2928b571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a064d446ad4feea4888963e9db6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:33:12.458834 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ed907f4d-01a0-4b3d-8907-ebf00bd859a9 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8" status: 200 len: 1572 microversion: 2.1 time: 0.158432 May 23 17:33:12.459410 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 513/1043] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:33:12 2022] GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8 => generated 1572 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:33:13.481815 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-df570db8-f7bd-449c-9dc0-a34b5e3fbb2b tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:33:13.483073 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-df570db8-f7bd-449c-9dc0-a34b5e3fbb2b tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:33:13.490165 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-df570db8-f7bd-449c-9dc0-a34b5e3fbb2b tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:33:13.490641 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-df570db8-f7bd-449c-9dc0-a34b5e3fbb2b tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:33:13.491436 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-df570db8-f7bd-449c-9dc0-a34b5e3fbb2b tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:33:13.491893 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-df570db8-f7bd-449c-9dc0-a34b5e3fbb2b tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:33:13.623574 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-df570db8-f7bd-449c-9dc0-a34b5e3fbb2b tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbe18db4b734d26b1820f0c2928b571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a064d446ad4feea4888963e9db6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:33:13.631489 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-df570db8-f7bd-449c-9dc0-a34b5e3fbb2b tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8" status: 200 len: 1572 microversion: 2.1 time: 0.157547 May 23 17:33:13.632056 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 531/1044] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:33:13 2022] GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8 => generated 1572 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:33:14.653989 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e6b91f03-1b7b-47bd-b458-60bc13d9c704 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:33:14.654973 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e6b91f03-1b7b-47bd-b458-60bc13d9c704 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:33:14.663862 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e6b91f03-1b7b-47bd-b458-60bc13d9c704 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:33:14.664302 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e6b91f03-1b7b-47bd-b458-60bc13d9c704 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:33:14.665581 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e6b91f03-1b7b-47bd-b458-60bc13d9c704 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:33:14.666400 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e6b91f03-1b7b-47bd-b458-60bc13d9c704 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:33:14.805855 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e6b91f03-1b7b-47bd-b458-60bc13d9c704 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbe18db4b734d26b1820f0c2928b571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a064d446ad4feea4888963e9db6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:33:14.814365 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e6b91f03-1b7b-47bd-b458-60bc13d9c704 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8" status: 200 len: 1572 microversion: 2.1 time: 0.166892 May 23 17:33:14.814931 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 514/1045] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:33:14 2022] GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8 => generated 1572 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:33:15.831676 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-21311ee3-8b99-4dd1-aee8-d9b485d7fa00 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:33:15.832296 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-21311ee3-8b99-4dd1-aee8-d9b485d7fa00 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:33:15.839278 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-21311ee3-8b99-4dd1-aee8-d9b485d7fa00 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:33:15.839730 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-21311ee3-8b99-4dd1-aee8-d9b485d7fa00 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:33:15.840511 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-21311ee3-8b99-4dd1-aee8-d9b485d7fa00 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:33:15.840980 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-21311ee3-8b99-4dd1-aee8-d9b485d7fa00 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:33:15.977726 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-21311ee3-8b99-4dd1-aee8-d9b485d7fa00 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbe18db4b734d26b1820f0c2928b571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a064d446ad4feea4888963e9db6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:33:15.990133 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-21311ee3-8b99-4dd1-aee8-d9b485d7fa00 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8" status: 200 len: 1572 microversion: 2.1 time: 0.162170 May 23 17:33:15.990905 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 532/1046] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:33:15 2022] GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8 => generated 1572 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:33:17.017645 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e3ec0f0b-52c3-483a-9869-1ac2ebad53c0 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:33:17.018709 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e3ec0f0b-52c3-483a-9869-1ac2ebad53c0 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:33:17.026013 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e3ec0f0b-52c3-483a-9869-1ac2ebad53c0 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:33:17.026467 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e3ec0f0b-52c3-483a-9869-1ac2ebad53c0 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:33:17.027257 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e3ec0f0b-52c3-483a-9869-1ac2ebad53c0 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:33:17.027697 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e3ec0f0b-52c3-483a-9869-1ac2ebad53c0 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:33:17.167438 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e3ec0f0b-52c3-483a-9869-1ac2ebad53c0 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbe18db4b734d26b1820f0c2928b571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a064d446ad4feea4888963e9db6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:33:17.178353 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e3ec0f0b-52c3-483a-9869-1ac2ebad53c0 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8" status: 200 len: 1572 microversion: 2.1 time: 0.168097 May 23 17:33:17.178888 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 515/1047] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:33:17 2022] GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8 => generated 1572 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:33:18.195633 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-73b98a1b-fe64-4a6f-8cba-77c9c87d938b tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:33:18.196258 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-73b98a1b-fe64-4a6f-8cba-77c9c87d938b tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:33:18.207466 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-73b98a1b-fe64-4a6f-8cba-77c9c87d938b tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:33:18.208217 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-73b98a1b-fe64-4a6f-8cba-77c9c87d938b tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:33:18.209633 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-73b98a1b-fe64-4a6f-8cba-77c9c87d938b tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:33:18.210523 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-73b98a1b-fe64-4a6f-8cba-77c9c87d938b tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:33:18.378153 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-73b98a1b-fe64-4a6f-8cba-77c9c87d938b tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbe18db4b734d26b1820f0c2928b571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a064d446ad4feea4888963e9db6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:33:18.391029 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-73b98a1b-fe64-4a6f-8cba-77c9c87d938b tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8" status: 200 len: 1572 microversion: 2.1 time: 0.199081 May 23 17:33:18.391926 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 533/1048] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:33:18 2022] GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8 => generated 1572 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:33:19.141478 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection May 23 17:33:19.142554 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Mon May 23 17:33:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 17:33:19.409911 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f2fe8792-1d79-483c-8633-39426cb08126 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:33:19.410505 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f2fe8792-1d79-483c-8633-39426cb08126 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:33:19.418081 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f2fe8792-1d79-483c-8633-39426cb08126 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:33:19.418532 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f2fe8792-1d79-483c-8633-39426cb08126 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:33:19.419308 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f2fe8792-1d79-483c-8633-39426cb08126 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:33:19.419738 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f2fe8792-1d79-483c-8633-39426cb08126 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:33:19.554908 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f2fe8792-1d79-483c-8633-39426cb08126 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbe18db4b734d26b1820f0c2928b571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a064d446ad4feea4888963e9db6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:33:19.565629 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f2fe8792-1d79-483c-8633-39426cb08126 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8" status: 200 len: 1572 microversion: 2.1 time: 0.159571 May 23 17:33:19.566454 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 516/1049] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:33:19 2022] GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8 => generated 1572 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:33:20.585094 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-709c2f11-c285-4cfa-980b-531e7fc4fa55 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:33:20.585746 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-709c2f11-c285-4cfa-980b-531e7fc4fa55 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:33:20.593057 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-709c2f11-c285-4cfa-980b-531e7fc4fa55 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:33:20.593501 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-709c2f11-c285-4cfa-980b-531e7fc4fa55 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:33:20.594260 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-709c2f11-c285-4cfa-980b-531e7fc4fa55 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:33:20.594687 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-709c2f11-c285-4cfa-980b-531e7fc4fa55 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:33:20.727692 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-709c2f11-c285-4cfa-980b-531e7fc4fa55 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbe18db4b734d26b1820f0c2928b571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a064d446ad4feea4888963e9db6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:33:20.735458 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-709c2f11-c285-4cfa-980b-531e7fc4fa55 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8" status: 200 len: 1559 microversion: 2.1 time: 0.155204 May 23 17:33:20.736039 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 534/1050] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:33:20 2022] GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:33:22.261734 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-64ba6faa-0105-4f45-90ec-cf544f0a4bb1 req-b8e13dc1-448a-46fc-923b-08db563574e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94a1d0ba-52d2-48de-83f9-1a391987dab8", "name": "network-vif-plugged", "status": "completed", "tag": "9abe54ee-d2b3-4019-b6b9-ade3640e3235"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:33:22.271160 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-64ba6faa-0105-4f45-90ec-cf544f0a4bb1 req-b8e13dc1-448a-46fc-923b-08db563574e7 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:33:22.271607 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-64ba6faa-0105-4f45-90ec-cf544f0a4bb1 req-b8e13dc1-448a-46fc-923b-08db563574e7 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:33:22.283446 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-64ba6faa-0105-4f45-90ec-cf544f0a4bb1 req-b8e13dc1-448a-46fc-923b-08db563574e7 service nova] Creating event network-vif-plugged:9abe54ee-d2b3-4019-b6b9-ade3640e3235 for instance 94a1d0ba-52d2-48de-83f9-1a391987dab8 on hv-cinder-84299 May 23 17:33:22.289781 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-64ba6faa-0105-4f45-90ec-cf544f0a4bb1 req-b8e13dc1-448a-46fc-923b-08db563574e7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032264 May 23 17:33:22.290621 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 517/1051] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:34:23.988663 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 17:34:23.989353 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Mon May 23 17:34:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 17:34:31.110484 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=26 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:34:31.112791 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=28 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:34:31.113862 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:34:31.114326 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:34:31.120457 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-f50cb5a5-0f80-4959-abc0-0e35eed81433 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:34:31.121752 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-f50cb5a5-0f80-4959-abc0-0e35eed81433 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:34:31.131738 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f50cb5a5-0f80-4959-abc0-0e35eed81433 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:34:31.132393 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f50cb5a5-0f80-4959-abc0-0e35eed81433 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:34:31.133448 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f50cb5a5-0f80-4959-abc0-0e35eed81433 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:34:31.133824 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f50cb5a5-0f80-4959-abc0-0e35eed81433 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:34:31.162247 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-f50cb5a5-0f80-4959-abc0-0e35eed81433 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Going to try to terminate instance {{(pid=117910) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 17:34:31.181067 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-d3f06288-ad11-4743-91ea-c978848395d2 req-fd39338e-cdf4-4387-a07c-698a3b49a174 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94a1d0ba-52d2-48de-83f9-1a391987dab8", "tag": "9abe54ee-d2b3-4019-b6b9-ade3640e3235"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:34:31.189737 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-d3f06288-ad11-4743-91ea-c978848395d2 req-fd39338e-cdf4-4387-a07c-698a3b49a174 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:34:31.190186 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-d3f06288-ad11-4743-91ea-c978848395d2 req-fd39338e-cdf4-4387-a07c-698a3b49a174 service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:34:31.201805 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-d3f06288-ad11-4743-91ea-c978848395d2 req-fd39338e-cdf4-4387-a07c-698a3b49a174 service nova] Creating event network-changed:9abe54ee-d2b3-4019-b6b9-ade3640e3235 for instance 94a1d0ba-52d2-48de-83f9-1a391987dab8 on hv-cinder-84299 May 23 17:34:31.207279 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-d3f06288-ad11-4743-91ea-c978848395d2 req-fd39338e-cdf4-4387-a07c-698a3b49a174 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096572 May 23 17:34:31.207816 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 518/1052] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:34:31.251765 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-f50cb5a5-0f80-4959-abc0-0e35eed81433 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "DELETE /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8" status: 204 len: 0 microversion: 2.1 time: 0.144259 May 23 17:34:31.253324 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 535/1053] 10.222.0.46 () {58 vars in 1238 bytes} [Mon May 23 17:34:31 2022] DELETE /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 17:34:31.263428 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5e63855b-420f-46ae-90eb-c070300182ea tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:34:31.264183 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5e63855b-420f-46ae-90eb-c070300182ea tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:34:31.271158 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5e63855b-420f-46ae-90eb-c070300182ea tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:34:31.271613 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5e63855b-420f-46ae-90eb-c070300182ea tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:34:31.272403 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5e63855b-420f-46ae-90eb-c070300182ea tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:34:31.272902 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5e63855b-420f-46ae-90eb-c070300182ea tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:34:31.412678 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5e63855b-420f-46ae-90eb-c070300182ea tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbe18db4b734d26b1820f0c2928b571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a064d446ad4feea4888963e9db6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:34:31.420452 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5e63855b-420f-46ae-90eb-c070300182ea tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8" status: 200 len: 1565 microversion: 2.1 time: 0.162407 May 23 17:34:31.421084 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 519/1054] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:34:31 2022] GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8 => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:34:32.441361 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-9899f710-f3a0-44f8-8fd7-03d9a88fb770 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:34:32.442082 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-9899f710-f3a0-44f8-8fd7-03d9a88fb770 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:34:32.449186 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9899f710-f3a0-44f8-8fd7-03d9a88fb770 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:34:32.451146 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9899f710-f3a0-44f8-8fd7-03d9a88fb770 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:34:32.451146 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9899f710-f3a0-44f8-8fd7-03d9a88fb770 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:34:32.451146 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9899f710-f3a0-44f8-8fd7-03d9a88fb770 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:34:32.605094 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9899f710-f3a0-44f8-8fd7-03d9a88fb770 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbe18db4b734d26b1820f0c2928b571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a064d446ad4feea4888963e9db6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:34:32.613487 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-9899f710-f3a0-44f8-8fd7-03d9a88fb770 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8" status: 200 len: 1565 microversion: 2.1 time: 0.176369 May 23 17:34:32.614102 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 536/1055] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:34:32 2022] GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8 => generated 1565 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:34:33.222505 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-1b061432-1405-4db7-94c8-a0a61f62ba57 req-1fa40c80-4095-4aeb-b80b-f41ff8b6a68a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94a1d0ba-52d2-48de-83f9-1a391987dab8", "name": "network-vif-deleted", "tag": "9abe54ee-d2b3-4019-b6b9-ade3640e3235"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 17:34:33.234289 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-1b061432-1405-4db7-94c8-a0a61f62ba57 req-1fa40c80-4095-4aeb-b80b-f41ff8b6a68a service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:34:33.234905 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-1b061432-1405-4db7-94c8-a0a61f62ba57 req-1fa40c80-4095-4aeb-b80b-f41ff8b6a68a service nova] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:34:33.246573 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-1b061432-1405-4db7-94c8-a0a61f62ba57 req-1fa40c80-4095-4aeb-b80b-f41ff8b6a68a service nova] Creating event network-vif-deleted:9abe54ee-d2b3-4019-b6b9-ade3640e3235 for instance 94a1d0ba-52d2-48de-83f9-1a391987dab8 on hv-cinder-84299 May 23 17:34:33.251570 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-1b061432-1405-4db7-94c8-a0a61f62ba57 req-1fa40c80-4095-4aeb-b80b-f41ff8b6a68a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034012 May 23 17:34:33.252188 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 520/1056] 10.222.0.46 () {64 vars in 1317 bytes} [Mon May 23 17:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 17:34:33.630682 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-29093d57-a560-4981-97d5-2982548169af tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:34:33.631925 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-29093d57-a560-4981-97d5-2982548169af tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:34:33.641282 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-29093d57-a560-4981-97d5-2982548169af tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:34:33.641728 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-29093d57-a560-4981-97d5-2982548169af tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:34:33.642516 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-29093d57-a560-4981-97d5-2982548169af tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:34:33.642949 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-29093d57-a560-4981-97d5-2982548169af tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:34:33.679003 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-29093d57-a560-4981-97d5-2982548169af tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:34:33.679451 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-29093d57-a560-4981-97d5-2982548169af tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:34:33.679900 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.objects.instance [None req-29093d57-a560-4981-97d5-2982548169af tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lazy-loading 'fault' on Instance uuid 94a1d0ba-52d2-48de-83f9-1a391987dab8 {{(pid=117910) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 17:34:33.725495 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-29093d57-a560-4981-97d5-2982548169af tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbe18db4b734d26b1820f0c2928b571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a064d446ad4feea4888963e9db6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} May 23 17:34:33.734003 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-29093d57-a560-4981-97d5-2982548169af tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8" status: 200 len: 1222 microversion: 2.1 time: 0.107283 May 23 17:34:33.734692 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 537/1057] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:34:33 2022] GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8 => generated 1222 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 17:34:34.576478 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 17:34:34.577411 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Mon May 23 17:34:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 17:34:34.758118 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-67077939-7fce-4501-90cf-6c2cb4a07952 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:34:34.759277 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-67077939-7fce-4501-90cf-6c2cb4a07952 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] [instance: 94a1d0ba-52d2-48de-83f9-1a391987dab8] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 17:34:34.771254 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-67077939-7fce-4501-90cf-6c2cb4a07952 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:34:34.772028 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-67077939-7fce-4501-90cf-6c2cb4a07952 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:34:34.773392 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-67077939-7fce-4501-90cf-6c2cb4a07952 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 17:34:34.774106 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-67077939-7fce-4501-90cf-6c2cb4a07952 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Lock "00a96999-6d6a-4eda-a805-882c38016a13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 17:34:34.789381 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-67077939-7fce-4501-90cf-6c2cb4a07952 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] HTTP exception thrown: Instance 94a1d0ba-52d2-48de-83f9-1a391987dab8 could not be found. May 23 17:34:34.791083 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-67077939-7fce-4501-90cf-6c2cb4a07952 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Request method failure captured: May 23 17:34:34.791083 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: request: GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8 HTTP/1.1 May 23 17:34:34.791083 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept: application/json May 23 17:34:34.791083 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity May 23 17:34:34.791083 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Connection: close May 23 17:34:34.791083 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Length: 0 May 23 17:34:34.791083 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Content-Type: application/json May 23 17:34:34.791083 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Host: 10.222.0.46 May 23 17:34:34.791083 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None May 23 17:34:34.791083 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.9 May 23 17:34:34.791083 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABii8Svn5SnwvnXJZtZMjhDblPRF5R2RmSBmPpxfIyP0TLldWoOgawhj_n-9fODeurkoQT-b66VRoU-B3lPuh5aA8lU9FjA5hvCvM0RMpuLvJuM_D-i7f4Ilq1DphzftzU9q6OuYV5GakNOmtUENQjyzojKVTs-bmEwbZFBad5tG_UaE04 May 23 17:34:34.791083 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Id: None May 23 17:34:34.791083 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Domain-Name: None May 23 17:34:34.791083 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed May 23 17:34:34.791083 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True May 23 17:34:34.791083 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default May 23 17:34:34.791083 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default May 23 17:34:34.791083 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Id: 62a064d446ad4feea4888963e9db6511 May 23 17:34:34.791083 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-TestShelveInstance-431420632 May 23 17:34:34.791083 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Role: reader,member May 23 17:34:34.791083 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Roles: reader,member May 23 17:34:34.792913 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/62a064d446ad4feea4888963e9db6511"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/62a064d446ad4feea4888963e9db6511"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/62a064d446ad4feea4888963e9db6511"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_62a064d446ad4feea4888963e9db6511"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] May 23 17:34:34.792913 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-TestShelveInstance-431420632 May 23 17:34:34.792913 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 62a064d446ad4feea4888963e9db6511 May 23 17:34:34.792913 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-TestShelveInstance-431420632 May 23 17:34:34.792913 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User: tempest-TestShelveInstance-431420632-project May 23 17:34:34.792913 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default May 23 17:34:34.792913 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default May 23 17:34:34.792913 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Id: fcbe18db4b734d26b1820f0c2928b571 May 23 17:34:34.792913 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-TestShelveInstance-431420632-project May 23 17:34:34.792913 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: method: > May 23 17:34:34.792913 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: exception: Instance 94a1d0ba-52d2-48de-83f9-1a391987dab8 could not be found. May 23 17:34:34.792913 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: action_args: {'id': '94a1d0ba-52d2-48de-83f9-1a391987dab8'} May 23 17:34:34.793883 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 17:34:34.793883 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:34:34.793883 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 17:34:34.793883 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 17:34:34.793883 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 17:34:34.793883 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 17:34:34.793883 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 17:34:34.793883 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 17:34:34.793883 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 17:34:34.793883 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 17:34:34.793883 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94a1d0ba-52d2-48de-83f9-1a391987dab8 could not be found. May 23 17:34:34.793883 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:34:34.793883 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:34:34.793883 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:34:34.793883 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:34:34.793883 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:34:34.793883 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:34:34.793883 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 17:34:34.793883 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 17:34:34.793883 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 17:34:34.795480 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 17:34:34.795480 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 17:34:34.795480 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 17:34:34.795480 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 17:34:34.795480 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 17:34:34.795480 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 17:34:34.795480 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 17:34:34.795480 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94a1d0ba-52d2-48de-83f9-1a391987dab8 could not be found. May 23 17:34:34.795480 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:34:34.795480 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 17:34:34.795480 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:34:34.795480 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 17:34:34.795480 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 17:34:34.795480 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 17:34:34.795480 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 17:34:34.795480 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 17:34:34.795480 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94a1d0ba-52d2-48de-83f9-1a391987dab8 could not be found. May 23 17:34:34.795480 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi May 23 17:34:34.797012 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-67077939-7fce-4501-90cf-6c2cb4a07952 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Returning 404 to user: Instance 94a1d0ba-52d2-48de-83f9-1a391987dab8 could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 17:34:34.797012 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-67077939-7fce-4501-90cf-6c2cb4a07952 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8" status: 404 len: 111 microversion: 2.1 time: 0.042250 May 23 17:34:34.797012 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 521/1058] 10.222.0.46 () {58 vars in 1235 bytes} [Mon May 23 17:34:34 2022] GET /compute/v2.1/servers/94a1d0ba-52d2-48de-83f9-1a391987dab8 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 17:34:34.957903 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-46b969ef-4256-4515-943e-6cf5ce639642 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] Calling method '.version_select at 0x7fd7a07249d0>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 17:34:34.982158 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-46b969ef-4256-4515-943e-6cf5ce639642 tempest-TestShelveInstance-431420632 tempest-TestShelveInstance-431420632-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-309170775" status: 202 len: 0 microversion: 2.1 time: 0.028127 May 23 17:34:34.982888 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 538/1059] 10.222.0.46 () {58 vars in 1250 bytes} [Mon May 23 17:34:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-309170775 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 17:36:27.843330 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 17:36:27.843878 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Mon May 23 17:36:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 17:37:32.494324 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 17:37:32.495261 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Mon May 23 17:37:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 17:37:44.002902 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 17:37:44.003579 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Mon May 23 17:37:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 17:37:54.589313 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 17:37:54.589973 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Mon May 23 17:37:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 17:39:43.918579 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 17:39:43.919288 dv-cinder-842998-1-iscsi devstack@n-api.service[117910]: Mon May 23 17:39:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 17:39:47.851942 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 17:39:47.852577 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Mon May 23 17:39:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 17:39:59.154827 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 17:39:59.155806 dv-cinder-842998-1-iscsi devstack@n-api.service[117909]: Mon May 23 17:39:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!